Sep 09 18:05:12 devstack cinder-volume[76630]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 09 18:05:12 devstack cinder-volume[76630]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 09 18:05:12 devstack cinder-volume[76630]: we strongly recommend against using it for new projects. Sep 09 18:05:12 devstack cinder-volume[76630]: If you are already using Eventlet, we recommend migrating to a different Sep 09 18:05:12 devstack cinder-volume[76630]: framework. For more detail see Sep 09 18:05:12 devstack cinder-volume[76630]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 09 18:05:12 devstack cinder-volume[76630]: import eventlet # noqa Sep 09 18:05:15 devstack cinder-volume[76630]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76630) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 18:05:15 devstack cinder-volume[76630]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76630) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 18:05:15 devstack cinder-volume[76630]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76630) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 18:05:16 devstack cinder-volume[76630]: INFO dbcounter [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Registered counter for database cinder Sep 09 18:05:16 devstack cinder-volume[76630]: DEBUG oslo_db.sqlalchemy.engines [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76630) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 18:05:16 devstack cinder-volume[76630]: DEBUG dbcounter [-] [76630] Writer thread running {{(pid=76630) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 18:05:16 devstack cinder-volume[76630]: INFO cinder.rpc [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 09 18:05:16 devstack cinder-volume[76630]: INFO cinder.rpc [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 09 18:05:16 devstack cinder-volume[76630]: DEBUG oslo_db.sqlalchemy.engines [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76630) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 18:05:16 devstack cinder-volume[76630]: INFO cinder.volume.manager [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Determined volume DB was empty at startup. Sep 09 18:05:16 devstack cinder-volume[76630]: DEBUG cinder.volume.manager [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76630) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 09 18:05:16 devstack cinder-volume[76630]: INFO cinder.volume.manager [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 09 18:05:16 devstack cinder-volume[76630]: WARNING stevedore.named [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 09 18:05:16 devstack cinder-volume[76630]: WARNING castellan.key_manager [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 18:05:16 devstack cinder-volume[76630]: WARNING cinder.keymgr.conf_key_mgr [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 18:05:16 devstack cinder-volume[76630]: DEBUG cinder.volume.drivers.lvm [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76630) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 09 18:05:16 devstack cinder-volume[76630]: DEBUG oslo_concurrency.processutils [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76630) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_concurrency.processutils [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] CMD "cinder-rtstool verify" returned: 0 in 0.433s {{(pid=76630) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_db.sqlalchemy.engines [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76630) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 18:05:17 devstack cinder-volume[76630]: INFO cinder.rpc [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 09 18:05:17 devstack cinder-volume[76630]: INFO cinder.rpc [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 09 18:05:17 devstack cinder-volume[76630]: WARNING stevedore.named [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 09 18:05:17 devstack cinder-volume[76630]: WARNING castellan.key_manager [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 18:05:17 devstack cinder-volume[76630]: INFO cinder.volume.manager [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_db.sqlalchemy.engines [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76630) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 18:05:17 devstack cinder-volume[76630]: INFO oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Starting 1 workers Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Started child 76784 {{(pid=76630) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Full set of CONF: {{(pid=76630) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] ******************************************************************************** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Configuration options gathered from: {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] ================================================================================ {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] allow_availability_zone_fallback = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] allow_compression_on_image_upload = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] allowed_direct_url_schemes = [] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] api_rate_limit = True {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76784]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] auth_strategy = keystone {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] az_cache_duration = 3600 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_availability_zone = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_host = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_name = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_stats_polling_interval = 60 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backup_api_class = cinder.backup.api.API {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backup_name_template = backup-%s {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backup_use_same_host = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backup_use_temp_snapshot = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] chap_password = **** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] chap_username = {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cinder_internal_tenant_project_id = a36e9695033841c092c0157c281c11ac {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cinder_internal_tenant_user_id = 29ce4b50c94646c5a3524f4036dacd88 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cloned_volume_same_az = True {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cluster = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] compression_format = gzip {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] compute_api_class = cinder.compute.nova.API {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] config_dir = [] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] config_source = [] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] control_exchange = openstack {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] debug = True {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] default_availability_zone = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] default_group_type = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] default_volume_type = lvmdriver-1 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] disk_geometry = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] driver_client_cert = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] driver_client_cert_key = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] driver_data_namespace = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] driver_ssl_cert_path = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] driver_ssl_cert_verify = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] driver_use_ssl = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] enable_force_upload = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] enable_new_services = True {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] enable_unsupported_driver = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] enforce_multipath_for_image_xfer = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] filter_function = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] glance_api_insecure = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] glance_api_servers = ['http://192.168.122.245/image'] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] glance_api_ssl_compression = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] glance_ca_certificates_file = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] glance_catalog_info = image:glance:publicURL {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] glance_certfile = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] glance_keyfile = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] glance_num_retries = 3 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] glance_request_timeout = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] goodness_function = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] graceful_shutdown_timeout = 5 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] group_api_class = cinder.group.api.API {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] host = devstack {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] image_compress_on_upload = True {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] image_conversion_address_space_limit = 1 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] image_conversion_cpu_limit = 60 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] image_conversion_disable = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] image_upload_use_cinder_backend = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] image_upload_use_internal_tenant = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] image_volume_cache_enabled = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] image_volume_cache_max_count = 0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] image_volume_cache_max_size_gb = 0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] init_host_max_objects_retrieval = 0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] instance_format = [instance: %(uuid)s] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] iscsi_target_flags = {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] iscsi_write_cache = on {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] iser_helper = tgtadm {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] iser_ip_address = 192.168.122.245 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] iser_port = 3260 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] log_color = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] log_config_append = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] log_dir = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] log_file = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] log_options = True {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] log_rotate_interval = 1 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] log_rotate_interval_type = days {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] log_rotation_type = none {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] max_age = 0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76784]: INFO cinder.volume.manager [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] max_logfile_count = 30 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] max_logfile_size_mb = 200 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] max_over_subscription_ratio = 20.0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] message_reap_interval = 86400 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] message_ttl = 2592000 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] migration_create_volume_timeout_secs = 300 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] monkey_patch = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] monkey_patch_modules = [] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] my_ip = 192.168.122.245 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] no_snapshot_gb_quota = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] num_iser_scan_tries = 3 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] num_shell_tries = 3 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] num_volume_device_scan_tries = 3 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] nvmeof_conn_info_version = 1 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] nvmet_ns_id = 10 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] nvmet_port_id = 1 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] osapi_max_limit = 1000 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] osapi_volume_ext_list = [] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] osapi_volume_listen_port = 8776 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] osapi_volume_use_ssl = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] osapi_volume_workers = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] per_volume_size_limit = -1 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] periodic_fuzzy_delay = 60 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] periodic_interval = 60 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] public_endpoint = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] publish_errors = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] quota_backup_gigabytes = 1000 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] quota_backups = 10 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] quota_gigabytes = 1000 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] quota_groups = 10 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] quota_snapshots = 10 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] quota_volumes = 10 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] rate_limit_burst = 0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] rate_limit_except_level = CRITICAL {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] rate_limit_interval = 0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] reinit_driver_count = 3 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] replication_device = **** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] report_discard_supported = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] report_interval = 120 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] reservation_clean_interval = 86400 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] reservation_expire = 86400 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] reserved_image_namespaces = [] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] reserved_percentage = 0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] rpc_response_timeout = 120 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] run_external_periodic_tasks = True {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] scst_target_driver = iscsi {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] scst_target_iqn_name = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] service_down_time = 720 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] shell_completion = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] snapshot_name_template = snapshot-%s {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] snapshot_same_host = True {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] split_loggers = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] state_path = /opt/stack/data/cinder {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] storage_availability_zone = nova {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] storage_protocol = iSCSI {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] syslog_log_facility = LOG_USER {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] target_helper = lioadm {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] target_ip_address = 192.168.122.245 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] target_port = 3260 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] target_protocol = iscsi {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] target_secondary_ip_addresses = [] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] trace_flags = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] transport_url = **** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] until_refresh = 0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] use_chap_auth = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] use_default_quota_class = True {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] use_journal = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] use_json = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] use_multipath_for_image_xfer = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] use_stderr = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] use_syslog = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] verify_glance_signatures = enabled {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] volume_api_class = cinder.volume.api.API {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] volume_backend_name = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] volume_clear = zero {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] volume_clear_ionice = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] volume_clear_size = 0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] volume_copy_bps_limit = 0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] volume_dd_blocksize = 1M {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] volume_name_template = volume-%s {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] volume_service_inithost_offload = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] volume_usage_audit_period = month {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] zoning_mode = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_concurrency.disable_process_locking = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.auth_section = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.auth_type = password {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.auth_version = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.cache = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.064s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.certfile = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.include_service_catalog = True {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.insecure = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.interface = public {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.keyfile = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.memcache_password = **** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.memcache_username = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.region_name = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.service_type = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.245/identity {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.backend = dogpile.cache.null {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.backend_argument = **** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.backend_expiration_time = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.config_prefix = cache.oslo {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.debug_cache_backend = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.enable_retry_client = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.enable_socket_keepalive = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.enabled = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.expiration_time = 600 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.hashclient_retry_attempts = 2 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.memcache_dead_retry = 300 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.memcache_pool_maxsize = 10 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.memcache_sasl_enabled = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.password = **** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.proxies = [] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.redis_db = 0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.redis_server = localhost:6379 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.retry_attempts = 2 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.retry_delay = 0.0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.socket_keepalive_count = 1 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.socket_keepalive_idle = 1 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.socket_keepalive_interval = 1 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.socket_timeout = 1.0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.tls_allowed_ciphers = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.tls_cafile = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.tls_certfile = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.tls_enabled = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.tls_keyfile = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cache.username = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] coordination.backend_url = **** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.asyncio_connection = **** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.asyncio_slave_connection = **** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.backend = sqlalchemy {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.connection = **** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.connection_debug = 0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.connection_parameters = {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.connection_recycle_time = 3600 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.connection_trace = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.db_inc_retry_interval = True {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.db_max_retries = 20 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.db_max_retry_interval = 10 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.db_retry_interval = 1 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.max_overflow = 50 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.max_pool_size = 5 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.max_retries = 10 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.mysql_wsrep_sync_wait = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.pool_timeout = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.retry_interval = 10 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.slave_connection = **** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.sqlite_synchronous = True {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.synchronous_reader = True {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] database.use_db_reconnect = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_tracing.insecure = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] profiler.connection_string = messaging:// {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] profiler.enabled = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] profiler.es_doc_type = notification {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] profiler.es_scroll_size = 10000 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] profiler.es_scroll_time = 2m {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] profiler.filter_error_trace = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] profiler.hmac_keys = **** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] profiler.sentinel_service_name = mymaster {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] profiler.socket_timeout = 0.1 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] profiler.trace_requests = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] profiler.trace_sqlalchemy = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] profiler_jaeger.process_tags = {} {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] profiler_jaeger.service_name_prefix = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] profiler_otlp.service_name_prefix = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_policy.enforce_new_defaults = True {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_policy.policy_default_rule = default {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_policy.policy_file = policy.yaml {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] privsep_osbrick.group = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] privsep_osbrick.helper_command = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] privsep_osbrick.user = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cinder_sys_admin.group = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cinder_sys_admin.helper_command = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] cinder_sys_admin.user = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] service_user.auth_section = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] service_user.auth_type = password {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] service_user.cafile = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] service_user.certfile = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] service_user.collect_timing = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] service_user.insecure = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] service_user.keyfile = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] service_user.send_service_user_token = True {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] service_user.split_loggers = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] service_user.timeout = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] service_user.tls_ciphers = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] service_user.tls_min_version = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] glance.auth_section = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] glance.auth_type = password {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] glance.certfile = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] glance.collect_timing = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack sudo[76788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 09 18:05:17 devstack sudo[76788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] glance.insecure = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] glance.keyfile = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] glance.region_name = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] glance.split_loggers = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] glance.timeout = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] glance.tls_ciphers = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] glance.tls_min_version = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.backend_availability_zone = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.chap_password = **** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.chap_username = {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.disk_geometry = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.driver_client_cert = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.driver_client_cert_key = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.driver_data_namespace = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.driver_use_ssl = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.extra_capabilities = {} {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.filter_function = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.goodness_function = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.iscsi_target_flags = {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.iscsi_write_cache = on {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.iser_helper = tgtadm {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.iser_ip_address = 192.168.122.245 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.iser_port = 3260 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.lvm_share_target = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.lvm_type = auto {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.num_shell_tries = 3 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.replication_device = **** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.report_discard_supported = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.reserved_percentage = 0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.target_helper = tgtadm {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.target_ip_address = 192.168.122.245 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.target_port = 3260 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.target_protocol = iscsi {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.trace_flags = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.unique_fqdn_network = True {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.use_chap_auth = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.volume_backend_name = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.volume_clear = zero {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.volume_clear_ionice = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.volume_clear_size = 0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_reports.file_event_handler = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_reports.log_dir = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.backend_host = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.chap_password = **** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.chap_username = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.disk_geometry = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.driver_client_cert = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.extra_capabilities = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.filter_function = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.goodness_function = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.iser_helper = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.iser_ip_address = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.iser_port = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.lvm_share_target = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.lvm_type = auto {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.num_shell_tries = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.replication_device = **** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.report_discard_supported = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.reserved_percentage = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.scst_target_driver = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.storage_protocol = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.target_helper = lioadm {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.target_ip_address = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.target_port = 3260 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.trace_flags = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.use_chap_auth = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.volume_clear = zero {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.volume_clear_size = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] lvmdriver-1.volumes_dir = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.ssl = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:17 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_notifications.driver = [] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_notifications.retry = -1 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] key_manager.fixed_key = **** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican.barbican_api_version = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican.barbican_endpoint = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican.barbican_endpoint_type = public {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican.barbican_region_name = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican.cafile = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican.certfile = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican.collect_timing = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican.insecure = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican.keyfile = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican.number_of_retries = 60 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican.retry_delay = 1 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican.send_service_user_token = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican.split_loggers = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican.timeout = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican.tls_ciphers = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican.tls_min_version = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican.verify_ssl = True {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican.verify_ssl_path = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican_service_user.auth_section = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican_service_user.auth_type = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican_service_user.cafile = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican_service_user.certfile = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican_service_user.collect_timing = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican_service_user.insecure = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican_service_user.keyfile = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican_service_user.split_loggers = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican_service_user.timeout = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican_service_user.tls_ciphers = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] barbican_service_user.tls_min_version = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] vault.approle_role_id = **** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] vault.approle_secret_id = **** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] vault.auth_method = approle {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] vault.auth_path = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] vault.kv_mountpoint = secret {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] vault.kv_path = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] vault.kv_version = 2 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] vault.namespace = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] vault.root_token_id = **** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] vault.ssl_ca_crt_file = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] vault.timeout = 60.0 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] vault.token_file = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] vault.token_role = None {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] vault.use_ssl = False {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:05:18 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] ******************************************************************************** {{(pid=76630) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 09 18:05:18 devstack sudo[76788]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:18 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.332s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:18 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:18 devstack sudo[76798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 18:05:18 devstack sudo[76798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:18 devstack sudo[76798]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:18 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.299s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:18 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:05:18 devstack cinder-volume[76784]: INFO cinder.brick.local_dev.lvm [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 09 18:05:18 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:18 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:18 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:18 devstack sudo[76931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 18:05:18 devstack sudo[76931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:18 devstack sudo[76931]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:18 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:18 devstack cinder-volume[76784]: DEBUG cinder.brick.local_dev.lvm [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76784) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 09 18:05:18 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:18 devstack sudo[77003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 18:05:18 devstack sudo[77003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:19 devstack sudo[77003]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:19 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.537s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:19 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:19 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:19 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:19 devstack sudo[77199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 18:05:19 devstack sudo[77199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:19 devstack sudo[77199]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:19 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:19 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:19 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:19 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:19 devstack sudo[77289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 09 18:05:19 devstack sudo[77289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:19 devstack sudo[77289]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:19 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.279s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:19 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:19 devstack sudo[77385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 18:05:19 devstack sudo[77385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:20 devstack sudo[77385]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:20 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:20 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:20 devstack sudo[77412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 18:05:20 devstack sudo[77412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:20 devstack sudo[77412]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:20 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.325s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:20 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:20 devstack sudo[77494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 18:05:20 devstack sudo[77494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:20 devstack sudo[77494]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:20 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:20 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:20 devstack sudo[77499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 18:05:20 devstack sudo[77499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:21 devstack sudo[77499]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:21 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:21 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:21 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:21 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:21 devstack sudo[77525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 18:05:21 devstack sudo[77525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:21 devstack sudo[77525]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:21 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:21 devstack cinder-volume[76784]: INFO cinder.volume.drivers.lvm [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 09 18:05:21 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:21 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:21 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:21 devstack sudo[77593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 18:05:21 devstack sudo[77593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:21 devstack sudo[77593]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:21 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:21 devstack cinder-volume[76784]: DEBUG cinder.volume.drivers.lvm [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Updating volume stats {{(pid=76784) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 18:05:21 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:21 devstack sudo[77596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 18:05:21 devstack sudo[77596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:22 devstack sudo[77596]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:22 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:22 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:22 devstack sudo[77605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 18:05:22 devstack sudo[77605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:22 devstack sudo[77605]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:22 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:22 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:22 devstack sudo[77608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 18:05:22 devstack sudo[77608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:22 devstack sudo[77608]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:22 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:22 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:22 devstack sudo[77611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 18:05:22 devstack sudo[77611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:22 devstack sudo[77611]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:22 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:22 devstack cinder-volume[76784]: INFO cinder.volume.driver [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Driver hasn't implemented _init_vendor_properties() Sep 09 18:05:22 devstack cinder-volume[76784]: DEBUG cinder.volume.driver [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76784) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 09 18:05:22 devstack cinder-volume[76784]: DEBUG oslo_db.sqlalchemy.engines [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76784) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 18:05:23 devstack cinder-volume[76784]: DEBUG dbcounter [-] [76784] Writer thread running {{(pid=76784) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 18:05:23 devstack cinder-volume[76784]: DEBUG cinder.db.api [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Building query based on filter {{(pid=76784) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 09 18:05:23 devstack cinder-volume[76784]: DEBUG cinder.image.image_utils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76784) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 09 18:05:23 devstack cinder-volume[76784]: INFO cinder.keymgr.migration [None req-126df956-5e4b-4581-85d7-8e2a24e5e72f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 09 18:05:23 devstack cinder-volume[76784]: DEBUG cinder.volume.drivers.lvm [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Updating volume stats {{(pid=76784) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 18:05:23 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:23 devstack sudo[77615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 18:05:23 devstack sudo[77615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:23 devstack sudo[77615]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:23 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:23 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:23 devstack sudo[77618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 18:05:23 devstack sudo[77618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:23 devstack sudo[77618]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:23 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:23 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:23 devstack sudo[77623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 18:05:23 devstack sudo[77623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:23 devstack sudo[77623]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:23 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:23 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:23 devstack sudo[77626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 18:05:23 devstack sudo[77626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:24 devstack sudo[77626]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:24 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:24 devstack cinder-volume[76784]: DEBUG cinder.manager [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Notifying Schedulers of capabilities ... {{(pid=76784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:05:24 devstack cinder-volume[76784]: INFO cinder.volume.manager [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Driver initialization completed successfully. Sep 09 18:05:24 devstack cinder-volume[76784]: INFO cinder.manager [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Initiating service 2 cleanup Sep 09 18:05:24 devstack cinder-volume[76784]: INFO cinder.manager [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Service 2 cleanup completed. Sep 09 18:05:24 devstack cinder-volume[76784]: DEBUG cinder.service [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Creating RPC server for service cinder-volume {{(pid=76784) start /opt/stack/cinder/cinder/service.py:231}} Sep 09 18:05:24 devstack cinder-volume[76784]: DEBUG cinder.service [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76784) start /opt/stack/cinder/cinder/service.py:237}} Sep 09 18:05:24 devstack cinder-volume[76784]: INFO cinder.volume.manager [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 09 18:05:24 devstack cinder-volume[76784]: DEBUG cinder.volume.drivers.lvm [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Updating volume stats {{(pid=76784) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 18:05:24 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:24 devstack sudo[77630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 18:05:24 devstack sudo[77630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:24 devstack sudo[77630]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:24 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:24 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:24 devstack sudo[77635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 18:05:24 devstack sudo[77635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:24 devstack sudo[77635]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:24 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:24 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:24 devstack sudo[77639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 18:05:24 devstack sudo[77639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:25 devstack sudo[77639]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:25 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:25 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:05:25 devstack sudo[77645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 18:05:25 devstack sudo[77645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:05:25 devstack sudo[77645]: pam_unix(sudo:session): session closed for user root Sep 09 18:05:25 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:05:25 devstack cinder-volume[76784]: INFO cinder.volume.manager [None req-95c57cf0-2cb6-4bbc-bf27-513844bbbe73 None None] Driver post RPC initialization completed successfully. Sep 09 18:05:27 devstack cinder-volume[76784]: DEBUG oslo_service.periodic_task [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running periodic task VolumeManager._thread_info {{(pid=76784) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:05:27 devstack cinder-volume[76784]: DEBUG cinder.volume.manager [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] thread count: 6 {{(pid=76784) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:05:27 devstack cinder-volume[76784]: DEBUG cinder.volume.manager [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] thread info: [<_MainThread(MainThread, started 130616024502400)>, , , , , ] {{(pid=76784) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:05:27 devstack cinder-volume[76630]: DEBUG dbcounter [-] [76630] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76630) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:05:35 devstack cinder-volume[76784]: DEBUG dbcounter [-] [76784] Writing DB stats cinder:SELECT=4 {{(pid=76784) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:05:35 devstack cinder-volume[76784]: DEBUG dbcounter [-] [76784] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76784) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:06:27 devstack cinder-volume[76784]: DEBUG oslo_service.periodic_task [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76784) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:06:27 devstack cinder-volume[76784]: DEBUG cinder.volume.drivers.lvm [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Updating volume stats {{(pid=76784) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 18:06:27 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:27 devstack sudo[79668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 18:06:27 devstack sudo[79668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:27 devstack sudo[79668]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:27 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:27 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:27 devstack sudo[79671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 18:06:27 devstack sudo[79671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:28 devstack sudo[79671]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:28 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:28 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:28 devstack sudo[79674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 18:06:28 devstack sudo[79674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:28 devstack sudo[79674]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:28 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:28 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:06:28 devstack sudo[79677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 18:06:28 devstack sudo[79677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:06:28 devstack sudo[79677]: pam_unix(sudo:session): session closed for user root Sep 09 18:06:28 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:06:28 devstack cinder-volume[76784]: DEBUG cinder.manager [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Notifying Schedulers of capabilities ... {{(pid=76784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:06:28 devstack cinder-volume[76784]: DEBUG oslo_service.periodic_task [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running periodic task VolumeManager._thread_info {{(pid=76784) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:06:28 devstack cinder-volume[76784]: DEBUG cinder.volume.manager [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] thread count: 6 {{(pid=76784) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:06:28 devstack cinder-volume[76784]: DEBUG cinder.volume.manager [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] thread info: [<_MainThread(MainThread, started 130616024502400)>, , , , , ] {{(pid=76784) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:07:27 devstack cinder-volume[76784]: DEBUG oslo_service.periodic_task [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76784) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:07:27 devstack cinder-volume[76784]: DEBUG cinder.volume.drivers.lvm [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Updating volume stats {{(pid=76784) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 18:07:27 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:27 devstack sudo[82966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 18:07:27 devstack sudo[82966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:27 devstack sudo[82966]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:27 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:27 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:27 devstack sudo[82974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 18:07:27 devstack sudo[82974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:28 devstack sudo[82974]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:28 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:28 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:28 devstack sudo[83012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 18:07:28 devstack sudo[83012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:28 devstack sudo[83012]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:28 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:28 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:07:28 devstack sudo[83016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 18:07:28 devstack sudo[83016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:07:28 devstack sudo[83016]: pam_unix(sudo:session): session closed for user root Sep 09 18:07:28 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:07:28 devstack cinder-volume[76784]: DEBUG cinder.manager [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Notifying Schedulers of capabilities ... {{(pid=76784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:07:28 devstack cinder-volume[76784]: DEBUG oslo_service.periodic_task [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running periodic task VolumeManager._thread_info {{(pid=76784) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:07:28 devstack cinder-volume[76784]: DEBUG cinder.volume.manager [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] thread count: 6 {{(pid=76784) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:07:28 devstack cinder-volume[76784]: DEBUG cinder.volume.manager [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] thread info: [<_MainThread(MainThread, started 130616024502400)>, , , , , ] {{(pid=76784) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:07:35 devstack cinder-volume[76784]: DEBUG dbcounter [-] [76784] Writing DB stats cinder:SELECT=1 {{(pid=76784) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:07:35 devstack cinder-volume[76784]: DEBUG dbcounter [-] [76784] Writing DB stats cinder:UPDATE=1 {{(pid=76784) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:08:27 devstack cinder-volume[76784]: DEBUG oslo_service.periodic_task [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76784) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:08:27 devstack cinder-volume[76784]: DEBUG cinder.volume.drivers.lvm [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Updating volume stats {{(pid=76784) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 18:08:27 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:27 devstack sudo[84987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 18:08:27 devstack sudo[84987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:27 devstack sudo[84987]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:27 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:27 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:27 devstack sudo[85013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 18:08:27 devstack sudo[85013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:28 devstack sudo[85013]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:28 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:28 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:28 devstack sudo[85021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 18:08:28 devstack sudo[85021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:28 devstack sudo[85021]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:28 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.284s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:28 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:08:28 devstack sudo[85038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 18:08:28 devstack sudo[85038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:08:28 devstack sudo[85038]: pam_unix(sudo:session): session closed for user root Sep 09 18:08:28 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:08:28 devstack cinder-volume[76784]: DEBUG cinder.manager [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Notifying Schedulers of capabilities ... {{(pid=76784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:09:27 devstack cinder-volume[76784]: DEBUG oslo_service.periodic_task [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76784) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:09:27 devstack cinder-volume[76784]: DEBUG cinder.volume.drivers.lvm [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Updating volume stats {{(pid=76784) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 18:09:27 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:09:27 devstack sudo[86171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 18:09:27 devstack sudo[86171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:09:27 devstack sudo[86171]: pam_unix(sudo:session): session closed for user root Sep 09 18:09:27 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:09:27 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:09:27 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 18:09:27 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:09:28 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Sep 09 18:09:28 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:09:28 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:09:28 devstack sudo[86177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 18:09:28 devstack sudo[86177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:09:28 devstack sudo[86177]: pam_unix(sudo:session): session closed for user root Sep 09 18:09:28 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:09:28 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:09:28 devstack sudo[86180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 18:09:28 devstack sudo[86180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:09:28 devstack sudo[86180]: pam_unix(sudo:session): session closed for user root Sep 09 18:09:28 devstack cinder-volume[76784]: DEBUG oslo_concurrency.processutils [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76784) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:09:28 devstack cinder-volume[76784]: DEBUG cinder.manager [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Notifying Schedulers of capabilities ... {{(pid=76784) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:09:28 devstack cinder-volume[76784]: DEBUG oslo_service.periodic_task [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] Running periodic task VolumeManager._thread_info {{(pid=76784) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:09:28 devstack cinder-volume[76784]: DEBUG cinder.volume.manager [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] thread count: 6 {{(pid=76784) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:09:28 devstack cinder-volume[76784]: DEBUG cinder.volume.manager [None req-880c42f4-257b-495d-b1f6-e95ce7dc2548 None None] thread info: [<_MainThread(MainThread, started 130616024502400)>, , , , , ] {{(pid=76784) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:09:35 devstack cinder-volume[76784]: DEBUG dbcounter [-] [76784] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76784) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:09:50 devstack cinder-volume[76630]: INFO oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Caught SIGTERM, stopping children Sep 09 18:09:50 devstack cinder-volume[76630]: DEBUG oslo_concurrency.lockutils [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Acquiring lock "singleton_lock" {{(pid=76630) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 18:09:50 devstack cinder-volume[76630]: DEBUG oslo_concurrency.lockutils [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Acquired lock "singleton_lock" {{(pid=76630) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 18:09:50 devstack cinder-volume[76630]: DEBUG oslo_concurrency.lockutils [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Releasing lock "singleton_lock" {{(pid=76630) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 18:09:50 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Stop services. {{(pid=76630) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 09 18:09:50 devstack cinder-volume[76630]: DEBUG oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Killing children. {{(pid=76630) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 09 18:09:50 devstack cinder-volume[76630]: INFO oslo_service.backend._eventlet.service [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Waiting on 1 children to exit Sep 09 18:09:55 devstack cinder-volume[76784]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 09 18:09:56 devstack cinder-volume[86811]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 09 18:09:56 devstack cinder-volume[86811]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 09 18:09:56 devstack cinder-volume[86811]: we strongly recommend against using it for new projects. Sep 09 18:09:56 devstack cinder-volume[86811]: If you are already using Eventlet, we recommend migrating to a different Sep 09 18:09:56 devstack cinder-volume[86811]: framework. For more detail see Sep 09 18:09:56 devstack cinder-volume[86811]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 09 18:09:56 devstack cinder-volume[86811]: import eventlet # noqa Sep 09 18:09:58 devstack cinder-volume[86811]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86811) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 18:09:58 devstack cinder-volume[86811]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86811) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 18:09:58 devstack cinder-volume[86811]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86811) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 18:09:58 devstack cinder-volume[86811]: INFO dbcounter [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Registered counter for database cinder Sep 09 18:09:58 devstack cinder-volume[86811]: DEBUG oslo_db.sqlalchemy.engines [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86811) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG dbcounter [-] [86811] Writer thread running {{(pid=86811) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 18:09:59 devstack cinder-volume[86811]: INFO cinder.rpc [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 09 18:09:59 devstack cinder-volume[86811]: INFO cinder.rpc [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_db.sqlalchemy.engines [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86811) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 18:09:59 devstack cinder-volume[86811]: INFO cinder.volume.manager [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Determined volume DB was empty at startup. Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG cinder.volume.manager [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86811) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 09 18:09:59 devstack cinder-volume[86811]: INFO cinder.volume.manager [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 09 18:09:59 devstack cinder-volume[86811]: WARNING stevedore.named [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 09 18:09:59 devstack cinder-volume[86811]: WARNING castellan.key_manager [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 18:09:59 devstack cinder-volume[86811]: WARNING cinder.keymgr.conf_key_mgr [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 18:09:59 devstack cinder-volume[86811]: INFO cinder.volume.manager [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_db.sqlalchemy.engines [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86811) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 18:09:59 devstack cinder-volume[76784]: DEBUG oslo_concurrency.lockutils [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Acquiring lock "singleton_lock" {{(pid=76784) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 18:09:59 devstack cinder-volume[76784]: DEBUG oslo_concurrency.lockutils [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Acquired lock "singleton_lock" {{(pid=76784) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 18:09:59 devstack cinder-volume[76784]: DEBUG oslo_concurrency.lockutils [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Releasing lock "singleton_lock" {{(pid=76784) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 18:09:59 devstack cinder-volume[76784]: WARNING amqp [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 09 18:09:59 devstack cinder-volume[76784]: WARNING amqp [None req-770a8065-061d-406e-b2fd-d9b34f1d6592 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 09 18:09:59 devstack cinder-volume[86811]: INFO oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Starting 1 workers Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Started child 87029 {{(pid=86811) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Full set of CONF: {{(pid=86811) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] ******************************************************************************** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Configuration options gathered from: {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] ================================================================================ {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] allow_availability_zone_fallback = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] allow_compression_on_image_upload = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] allowed_direct_url_schemes = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] api_rate_limit = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] auth_strategy = keystone {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_availability_zone = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_host = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_stats_polling_interval = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backup_api_class = cinder.backup.api.API {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backup_name_template = backup-%s {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backup_use_same_host = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backup_use_temp_snapshot = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] chap_password = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] chap_username = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cinder_internal_tenant_project_id = a36e9695033841c092c0157c281c11ac {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cinder_internal_tenant_user_id = 29ce4b50c94646c5a3524f4036dacd88 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cluster = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] compression_format = gzip {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] compute_api_class = cinder.compute.nova.API {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] config_dir = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] config_source = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] control_exchange = openstack {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] debug = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] default_availability_zone = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] default_group_type = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] default_volume_type = QuobyteHD {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] disk_geometry = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] driver_client_cert = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] driver_client_cert_key = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] driver_data_namespace = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] driver_ssl_cert_path = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] driver_ssl_cert_verify = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] driver_use_ssl = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] enable_new_services = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] enable_unsupported_driver = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] enabled_backends = ['QuobyteHD'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] enforce_multipath_for_image_xfer = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] filter_function = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] glance_api_insecure = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] glance_api_servers = ['http://192.168.122.245/image'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] glance_api_ssl_compression = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] glance_ca_certificates_file = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] glance_catalog_info = image:glance:publicURL {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] glance_certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] glance_keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] glance_num_retries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] glance_request_timeout = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[87029]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] goodness_function = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] graceful_shutdown_timeout = 5 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] group_api_class = cinder.group.api.API {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] host = devstack {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] image_compress_on_upload = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] image_conversion_address_space_limit = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] image_conversion_cpu_limit = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] image_conversion_disable = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] image_upload_use_cinder_backend = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] image_upload_use_internal_tenant = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] image_volume_cache_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] image_volume_cache_max_count = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] image_volume_cache_max_size_gb = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] init_host_max_objects_retrieval = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] instance_format = [instance: %(uuid)s] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] iscsi_target_flags = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] iscsi_write_cache = on {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] iser_helper = tgtadm {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] iser_ip_address = 192.168.122.245 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] iser_port = 3260 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] log_color = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] log_config_append = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] log_dir = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] log_file = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] log_options = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] log_rotate_interval = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] log_rotate_interval_type = days {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] log_rotation_type = none {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] max_age = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] max_logfile_count = 30 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] max_logfile_size_mb = 200 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] max_over_subscription_ratio = 20.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] message_reap_interval = 86400 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] message_ttl = 2592000 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] migration_create_volume_timeout_secs = 300 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] monkey_patch = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] monkey_patch_modules = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] my_ip = 192.168.122.245 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] no_snapshot_gb_quota = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] num_iser_scan_tries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] num_shell_tries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] num_volume_device_scan_tries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] nvmeof_conn_info_version = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] nvmet_ns_id = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] nvmet_port_id = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] osapi_max_limit = 1000 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] osapi_volume_ext_list = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] osapi_volume_listen = 0.0.0.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] osapi_volume_listen_port = 8776 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] osapi_volume_use_ssl = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] osapi_volume_workers = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] per_volume_size_limit = -1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] periodic_fuzzy_delay = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] periodic_interval = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] project_id_regex = [0-9a-f\-]+ {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] public_endpoint = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] publish_errors = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] quota_backup_gigabytes = 1000 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] quota_backups = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] quota_gigabytes = 1000 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] quota_groups = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] quota_snapshots = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] quota_volumes = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] rate_limit_burst = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] rate_limit_except_level = CRITICAL {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] rate_limit_interval = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] reinit_driver_count = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] replication_device = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] report_discard_supported = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] report_interval = 120 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] reservation_clean_interval = 86400 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] reservation_expire = 86400 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] reserved_image_namespaces = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] reserved_percentage = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] rpc_response_timeout = 120 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] run_external_periodic_tasks = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] scst_target_driver = iscsi {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] scst_target_iqn_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] service_down_time = 720 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] shell_completion = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] snapshot_name_template = snapshot-%s {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] split_loggers = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] state_path = /opt/stack/data/cinder {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] storage_availability_zone = nova {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] storage_protocol = iSCSI {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] syslog_log_facility = LOG_USER {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] target_helper = lioadm {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] target_ip_address = 192.168.122.245 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] target_port = 3260 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] target_protocol = iscsi {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] target_secondary_ip_addresses = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] trace_flags = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] transfer_api_class = cinder.transfer.api.API {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] transport_url = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] until_refresh = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] use_chap_auth = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] use_default_quota_class = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] use_journal = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] use_json = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] use_multipath_for_image_xfer = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] use_stderr = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] use_syslog = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] verify_glance_signatures = enabled {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] volume_api_class = cinder.volume.api.API {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] volume_backend_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] volume_clear = zero {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] volume_clear_ionice = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] volume_clear_size = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] volume_copy_bps_limit = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] volume_dd_blocksize = 1M {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] volume_name_template = volume-%s {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] volume_service_inithost_offload = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] volume_usage_audit_period = month {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] zoning_mode = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_concurrency.disable_process_locking = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.auth_section = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.auth_type = password {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.auth_version = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.cache = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.delay_auth_decision = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.http_connect_timeout = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.include_service_catalog = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.insecure = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.interface = public {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.memcache_password = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.memcache_username = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.region_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.service_token_roles_required = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.service_type = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.token_cache_time = 300 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.245/identity {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.backend = dogpile.cache.null {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.backend_argument = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.backend_expiration_time = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.config_prefix = cache.oslo {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.debug_cache_backend = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.enable_retry_client = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.enable_socket_keepalive = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.expiration_time = 600 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.hashclient_retry_attempts = 2 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.memcache_dead_retry = 300 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.memcache_pool_maxsize = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.memcache_sasl_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.password = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.proxies = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.redis_db = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.redis_sentinel_service_name = mymaster {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.redis_server = localhost:6379 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.retry_attempts = 2 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.retry_delay = 0.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.socket_keepalive_count = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.socket_keepalive_idle = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.socket_keepalive_interval = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.socket_timeout = 1.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.tls_allowed_ciphers = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.tls_cafile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.tls_certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.tls_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.tls_keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cache.username = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] coordination.backend_url = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.asyncio_connection = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.asyncio_slave_connection = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.backend = sqlalchemy {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.connection = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.connection_debug = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.connection_parameters = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.connection_recycle_time = 3600 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.connection_trace = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.db_inc_retry_interval = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.db_max_retries = 20 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.db_max_retry_interval = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.db_retry_interval = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.max_overflow = 50 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.max_pool_size = 5 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.max_retries = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.mysql_wsrep_sync_wait = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.pool_timeout = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.retry_interval = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.slave_connection = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.sqlite_synchronous = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.synchronous_reader = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] database.use_db_reconnect = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_tracing.insecure = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] profiler.connection_string = messaging:// {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[87029]: INFO cinder.volume.manager [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] profiler.enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] profiler.es_doc_type = notification {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] profiler.es_scroll_size = 10000 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] profiler.es_scroll_time = 2m {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] profiler.filter_error_trace = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] profiler.hmac_keys = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] profiler.sentinel_service_name = mymaster {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] profiler.socket_timeout = 0.1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] profiler.trace_requests = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] profiler.trace_sqlalchemy = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[87029]: DEBUG cinder.volume.drivers.remotefs [None req-69e64f90-266a-40f6-9184-88568e287968 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87029) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] profiler_jaeger.process_tags = {} {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] profiler_jaeger.service_name_prefix = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] profiler_otlp.service_name_prefix = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_policy.enforce_new_defaults = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_policy.policy_default_rule = default {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_policy.policy_file = policy.yaml {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_policy.remote_timeout = 60.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] privsep_osbrick.group = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] privsep_osbrick.helper_command = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] privsep_osbrick.user = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cinder_sys_admin.group = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cinder_sys_admin.helper_command = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] cinder_sys_admin.user = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] service_user.auth_section = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] service_user.auth_type = password {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] service_user.cafile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] service_user.certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] service_user.collect_timing = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] service_user.insecure = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] service_user.keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] service_user.send_service_user_token = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] service_user.split_loggers = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] service_user.timeout = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] service_user.tls_ciphers = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] service_user.tls_min_version = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] glance.auth_section = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] glance.auth_type = password {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] glance.certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] glance.collect_timing = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] glance.insecure = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] glance.keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] glance.region_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] glance.split_loggers = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] glance.timeout = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] glance.tls_ciphers = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] glance.tls_min_version = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.backend_availability_zone = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.chap_password = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.chap_username = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.disk_geometry = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.driver_client_cert = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.driver_client_cert_key = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.driver_data_namespace = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.driver_use_ssl = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.enable_unsupported_driver = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.extra_capabilities = {} {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.filter_function = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.goodness_function = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.iscsi_target_flags = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.iscsi_write_cache = on {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.iser_helper = tgtadm {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.iser_ip_address = 192.168.122.245 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.iser_port = 3260 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.nas_host = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.nas_login = admin {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.nas_mount_options = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.nas_password = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.nas_private_key = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.nas_share_path = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.nas_ssh_port = 22 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.num_shell_tries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.nvmet_port_id = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.quobyte_client_cfg = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.quobyte_volume_url = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.replication_device = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.report_discard_supported = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.reserved_percentage = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.scst_target_driver = iscsi {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.scst_target_iqn_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.storage_protocol = iSCSI {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.target_helper = tgtadm {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.target_ip_address = 192.168.122.245 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.target_port = 3260 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.target_protocol = iscsi {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.trace_flags = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.unique_fqdn_network = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.use_chap_auth = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.volume_backend_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.volume_clear = zero {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.volume_clear_ionice = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.volume_clear_size = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_reports.file_event_handler = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_reports.log_dir = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.backend_availability_zone = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.backend_host = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.chap_password = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.chap_username = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.chiscsi_conf = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.disk_geometry = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.driver_client_cert = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.driver_client_cert_key = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.driver_data_namespace = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.driver_use_ssl = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.extra_capabilities = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.filter_function = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.goodness_function = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.iscsi_target_flags = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.iscsi_write_cache = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.iser_helper = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.iser_ip_address = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.iser_port = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.iser_target_prefix = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.nas_host = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.nas_login = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.nas_mount_options = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.nas_password = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.nas_private_key = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.nas_share_path = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.nas_ssh_port = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.num_shell_tries = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.nvmet_ns_id = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.nvmet_port_id = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.replication_device = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.report_discard_supported = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.reserved_percentage = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.scst_target_driver = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.storage_protocol = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.target_helper = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.target_ip_address = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.target_port = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.target_prefix = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.target_protocol = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.trace_flags = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.unique_fqdn_network = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.use_chap_auth = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.volume_clear = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.volume_clear_ionice = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.volume_clear_size = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] QuobyteHD.volumes_dir = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.ssl = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.ssl_version = {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_notifications.driver = [] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_notifications.retry = -1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] oslo_messaging_notifications.transport_url = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] key_manager.fixed_key = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican.barbican_api_version = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican.barbican_endpoint = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican.barbican_endpoint_type = public {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican.barbican_region_name = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican.cafile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican.certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican.collect_timing = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican.insecure = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican.keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican.number_of_retries = 60 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican.retry_delay = 1 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican.send_service_user_token = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican.split_loggers = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican.timeout = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican.tls_ciphers = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican.tls_min_version = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican.verify_ssl = True {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican.verify_ssl_path = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican_service_user.auth_section = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican_service_user.auth_type = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican_service_user.cafile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican_service_user.certfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican_service_user.collect_timing = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican_service_user.insecure = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican_service_user.keyfile = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican_service_user.split_loggers = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican_service_user.timeout = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican_service_user.tls_ciphers = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] barbican_service_user.tls_min_version = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] vault.approle_role_id = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] vault.approle_secret_id = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] vault.auth_method = approle {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] vault.auth_path = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] vault.kv_mountpoint = secret {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] vault.kv_path = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] vault.kv_version = 2 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] vault.namespace = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] vault.root_token_id = **** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] vault.ssl_ca_crt_file = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] vault.timeout = 60.0 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] vault.token_file = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] vault.token_role = None {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] vault.use_ssl = False {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:09:59 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] ******************************************************************************** {{(pid=86811) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 09 18:09:59 devstack cinder-volume[87029]: DEBUG cinder.volume.drivers.quobyte [None req-69e64f90-266a-40f6-9184-88568e287968 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87029) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 09 18:09:59 devstack cinder-volume[87029]: WARNING cinder.volume.drivers.quobyte [None req-69e64f90-266a-40f6-9184-88568e287968 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 09 18:09:59 devstack cinder-volume[87029]: WARNING cinder.volume.drivers.quobyte [None req-69e64f90-266a-40f6-9184-88568e287968 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 09 18:09:59 devstack cinder-volume[87029]: DEBUG oslo_concurrency.processutils [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Running cmd (subprocess): mount.quobyte {{(pid=87029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:09:59 devstack quobyte-client[87030]: Reading configuration file: /etc/quobyte/client.cfg Sep 09 18:09:59 devstack quobyte-client[87030]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 09 18:09:59 devstack cinder-volume[87029]: DEBUG oslo_concurrency.processutils [None req-69e64f90-266a-40f6-9184-88568e287968 None None] CMD "mount.quobyte" returned: 1 in 0.087s {{(pid=87029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:09:59 devstack cinder-volume[87029]: DEBUG oslo_concurrency.lockutils [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:09:59 devstack cinder-volume[87029]: DEBUG oslo_concurrency.lockutils [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:09:59 devstack cinder-volume[87029]: DEBUG cinder.volume.drivers.quobyte [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:09:59 devstack cinder-volume[87029]: INFO cinder.volume.drivers.quobyte [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f ... Sep 09 18:09:59 devstack cinder-volume[87029]: DEBUG oslo_concurrency.processutils [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 -c /etc/quobyte/client-cinder.cfg {{(pid=87029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:09:59 devstack sudo[87031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 -c /etc/quobyte/client-cinder.cfg Sep 09 18:09:59 devstack sudo[87031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:10:00 devstack sudo[87031]: pam_unix(sudo:session): session closed for user root Sep 09 18:10:00 devstack cinder-volume[87029]: DEBUG oslo_concurrency.processutils [None req-69e64f90-266a-40f6-9184-88568e287968 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.475s {{(pid=87029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:10:00 devstack cinder-volume[87029]: INFO cinder.volume.drivers.quobyte [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f succeeded Sep 09 18:10:00 devstack cinder-volume[87029]: DEBUG cinder.volume.drivers.quobyte [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:10:00 devstack cinder-volume[87029]: DEBUG oslo_concurrency.lockutils [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.487s {{(pid=87029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:10:00 devstack cinder-volume[87029]: DEBUG oslo_concurrency.processutils [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:10:00 devstack sudo[87110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:10:00 devstack sudo[87110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:10:00 devstack sudo[87110]: pam_unix(sudo:session): session closed for user root Sep 09 18:10:00 devstack cinder-volume[87029]: DEBUG oslo_concurrency.processutils [None req-69e64f90-266a-40f6-9184-88568e287968 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.237s {{(pid=87029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:10:00 devstack cinder-volume[87029]: INFO cinder.volume.driver [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Driver hasn't implemented _init_vendor_properties() Sep 09 18:10:00 devstack cinder-volume[87029]: DEBUG cinder.volume.driver [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.32279586792, 'free_capacity_gb': 1773.32279586792, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87029) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 09 18:10:00 devstack cinder-volume[87029]: DEBUG oslo_db.sqlalchemy.engines [None req-69e64f90-266a-40f6-9184-88568e287968 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87029) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 18:10:00 devstack cinder-volume[87029]: DEBUG dbcounter [-] [87029] Writer thread running {{(pid=87029) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 18:10:00 devstack cinder-volume[87029]: DEBUG cinder.db.api [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Building query based on filter {{(pid=87029) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 09 18:10:00 devstack cinder-volume[87029]: DEBUG cinder.image.image_utils [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87029) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 09 18:10:00 devstack cinder-volume[87029]: INFO cinder.keymgr.migration [None req-46b56db0-e524-4a5b-a2e3-695e7ab4a6da None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 09 18:10:00 devstack cinder-volume[87029]: DEBUG oslo_concurrency.lockutils [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:10:00 devstack cinder-volume[87029]: DEBUG oslo_concurrency.lockutils [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:10:00 devstack cinder-volume[87029]: DEBUG cinder.volume.drivers.quobyte [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:10:00 devstack cinder-volume[87029]: DEBUG cinder.volume.drivers.quobyte [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:10:00 devstack cinder-volume[87029]: DEBUG oslo_concurrency.lockutils [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:10:00 devstack cinder-volume[87029]: DEBUG oslo_concurrency.processutils [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:10:00 devstack sudo[87114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:10:00 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:10:00 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root Sep 09 18:10:00 devstack cinder-volume[87029]: DEBUG oslo_concurrency.processutils [None req-69e64f90-266a-40f6-9184-88568e287968 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.232s {{(pid=87029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:10:00 devstack cinder-volume[87029]: DEBUG cinder.manager [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Notifying Schedulers of capabilities ... {{(pid=87029) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:10:00 devstack cinder-volume[87029]: INFO cinder.volume.manager [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Driver initialization completed successfully. Sep 09 18:10:00 devstack cinder-volume[87029]: INFO cinder.manager [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Initiating service 3 cleanup Sep 09 18:10:00 devstack cinder-volume[87029]: INFO cinder.manager [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Service 3 cleanup completed. Sep 09 18:10:00 devstack cinder-volume[87029]: DEBUG cinder.service [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Creating RPC server for service cinder-volume {{(pid=87029) start /opt/stack/cinder/cinder/service.py:231}} Sep 09 18:10:00 devstack cinder-volume[87029]: DEBUG cinder.service [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87029) start /opt/stack/cinder/cinder/service.py:237}} Sep 09 18:10:01 devstack cinder-volume[87029]: INFO cinder.volume.manager [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 09 18:10:01 devstack cinder-volume[87029]: DEBUG oslo_concurrency.lockutils [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:10:01 devstack cinder-volume[87029]: DEBUG oslo_concurrency.lockutils [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:10:01 devstack cinder-volume[87029]: DEBUG cinder.volume.drivers.quobyte [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87029) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:10:01 devstack cinder-volume[87029]: DEBUG cinder.volume.drivers.quobyte [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87029) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:10:01 devstack cinder-volume[87029]: DEBUG oslo_concurrency.lockutils [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87029) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:10:01 devstack cinder-volume[87029]: DEBUG oslo_concurrency.processutils [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:10:01 devstack sudo[87117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:10:01 devstack sudo[87117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:10:01 devstack sudo[87117]: pam_unix(sudo:session): session closed for user root Sep 09 18:10:01 devstack cinder-volume[87029]: DEBUG oslo_concurrency.processutils [None req-69e64f90-266a-40f6-9184-88568e287968 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.240s {{(pid=87029) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:10:01 devstack cinder-volume[87029]: INFO cinder.volume.manager [None req-69e64f90-266a-40f6-9184-88568e287968 None None] Driver post RPC initialization completed successfully. Sep 09 18:10:05 devstack cinder-volume[86811]: INFO oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Caught SIGTERM, stopping children Sep 09 18:10:05 devstack cinder-volume[86811]: DEBUG oslo_concurrency.lockutils [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Acquiring lock "singleton_lock" {{(pid=86811) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 18:10:05 devstack cinder-volume[86811]: DEBUG oslo_concurrency.lockutils [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Acquired lock "singleton_lock" {{(pid=86811) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 18:10:05 devstack cinder-volume[86811]: DEBUG oslo_concurrency.lockutils [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Releasing lock "singleton_lock" {{(pid=86811) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 18:10:05 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Stop services. {{(pid=86811) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 09 18:10:05 devstack cinder-volume[86811]: DEBUG oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Killing children. {{(pid=86811) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 09 18:10:05 devstack cinder-volume[86811]: INFO oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Waiting on 1 children to exit Sep 09 18:10:09 devstack cinder-volume[87029]: DEBUG oslo_concurrency.lockutils [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Acquiring lock "singleton_lock" {{(pid=87029) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 18:10:09 devstack cinder-volume[87029]: DEBUG oslo_concurrency.lockutils [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Acquired lock "singleton_lock" {{(pid=87029) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 18:10:09 devstack cinder-volume[87029]: DEBUG oslo_concurrency.lockutils [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Releasing lock "singleton_lock" {{(pid=87029) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 18:10:09 devstack cinder-volume[87029]: WARNING amqp [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 09 18:10:09 devstack cinder-volume[87029]: WARNING amqp [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 09 18:10:09 devstack cinder-volume[86811]: INFO oslo_service.backend._eventlet.service [None req-47ec7e39-5381-4a87-b1c7-8a807736c4df None None] Child 87029 exited with status 0 Sep 09 18:10:10 devstack cinder-volume[87329]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 09 18:10:10 devstack cinder-volume[87329]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 09 18:10:10 devstack cinder-volume[87329]: we strongly recommend against using it for new projects. Sep 09 18:10:10 devstack cinder-volume[87329]: If you are already using Eventlet, we recommend migrating to a different Sep 09 18:10:10 devstack cinder-volume[87329]: framework. For more detail see Sep 09 18:10:10 devstack cinder-volume[87329]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 09 18:10:10 devstack cinder-volume[87329]: import eventlet # noqa Sep 09 18:10:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 18:10:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 18:10:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87329) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 18:10:13 devstack cinder-volume[87329]: INFO dbcounter [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] Registered counter for database cinder Sep 09 18:10:13 devstack cinder-volume[87329]: DEBUG oslo_db.sqlalchemy.engines [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87329) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 18:10:13 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writer thread running {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 18:10:13 devstack cinder-volume[87329]: INFO cinder.rpc [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 09 18:10:13 devstack cinder-volume[87329]: INFO cinder.rpc [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 09 18:10:13 devstack cinder-volume[87329]: DEBUG oslo_db.sqlalchemy.engines [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87329) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 18:10:13 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] Determined volume DB was empty at startup. Sep 09 18:10:13 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87329) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 09 18:10:13 devstack cinder-volume[87329]: WARNING stevedore.named [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 09 18:10:13 devstack cinder-volume[87329]: WARNING castellan.key_manager [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 18:10:13 devstack cinder-volume[87329]: WARNING cinder.keymgr.conf_key_mgr [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 18:10:13 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 09 18:10:13 devstack cinder-volume[87329]: DEBUG oslo_db.sqlalchemy.engines [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87329) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 18:10:13 devstack cinder-volume[87329]: INFO oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] Starting 1 workers Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] Started child 87639 {{(pid=87329) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] Full set of CONF: {{(pid=87329) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] ******************************************************************************** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] Configuration options gathered from: {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] ================================================================================ {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] allow_availability_zone_fallback = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] allow_compression_on_image_upload = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] allowed_direct_url_schemes = [] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] api_rate_limit = True {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] auth_strategy = keystone {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_availability_zone = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_host = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_name = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_stats_polling_interval = 60 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backup_api_class = cinder.backup.api.API {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backup_name_template = backup-%s {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backup_use_same_host = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backup_use_temp_snapshot = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] chap_password = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] chap_username = {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cinder_internal_tenant_project_id = a36e9695033841c092c0157c281c11ac {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87639]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cinder_internal_tenant_user_id = 29ce4b50c94646c5a3524f4036dacd88 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cluster = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] compression_format = gzip {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] compute_api_class = cinder.compute.nova.API {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] config_dir = [] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] config_source = [] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] control_exchange = openstack {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] debug = True {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] default_availability_zone = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] default_group_type = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] default_volume_type = QuobyteHD {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] disk_geometry = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] driver_client_cert = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] driver_client_cert_key = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] driver_data_namespace = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] driver_ssl_cert_path = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] driver_ssl_cert_verify = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] driver_use_ssl = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] enable_new_services = True {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] enable_unsupported_driver = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] enabled_backends = ['QuobyteHD'] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] enforce_multipath_for_image_xfer = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] filter_function = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] glance_api_insecure = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] glance_api_servers = ['http://192.168.122.245/image'] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] glance_api_ssl_compression = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] glance_ca_certificates_file = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] glance_catalog_info = image:glance:publicURL {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] glance_certfile = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] glance_keyfile = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] glance_num_retries = 3 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] glance_request_timeout = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] goodness_function = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] graceful_shutdown_timeout = 5 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] group_api_class = cinder.group.api.API {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] host = devstack {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] image_compress_on_upload = True {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] image_conversion_address_space_limit = 1 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] image_conversion_cpu_limit = 60 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] image_conversion_disable = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] image_upload_use_cinder_backend = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] image_upload_use_internal_tenant = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] image_volume_cache_enabled = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] image_volume_cache_max_count = 0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] image_volume_cache_max_size_gb = 0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] init_host_max_objects_retrieval = 0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] instance_format = [instance: %(uuid)s] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] iscsi_target_flags = {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] iscsi_write_cache = on {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] iser_helper = tgtadm {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] iser_ip_address = 192.168.122.245 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] iser_port = 3260 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] log_color = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] log_config_append = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] log_dir = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] log_file = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] log_options = True {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] log_rotate_interval = 1 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] log_rotate_interval_type = days {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] log_rotation_type = none {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] max_age = 0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] max_logfile_count = 30 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] max_logfile_size_mb = 200 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] max_over_subscription_ratio = 20.0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] message_reap_interval = 86400 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] message_ttl = 2592000 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87639) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] migration_create_volume_timeout_secs = 300 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] monkey_patch = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] monkey_patch_modules = [] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] my_ip = 192.168.122.245 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] no_snapshot_gb_quota = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] num_iser_scan_tries = 3 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] num_shell_tries = 3 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] num_volume_device_scan_tries = 3 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] nvmeof_conn_info_version = 1 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] nvmet_ns_id = 10 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] nvmet_port_id = 1 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] osapi_max_limit = 1000 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] osapi_volume_ext_list = [] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] osapi_volume_listen = 0.0.0.0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] osapi_volume_listen_port = 8776 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] osapi_volume_use_ssl = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] osapi_volume_workers = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] per_volume_size_limit = -1 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] periodic_fuzzy_delay = 60 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] periodic_interval = 60 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] project_id_regex = [0-9a-f\-]+ {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] public_endpoint = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] publish_errors = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] quota_backup_gigabytes = 1000 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] quota_backups = 10 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] quota_gigabytes = 1000 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] quota_groups = 10 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] quota_snapshots = 10 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] quota_volumes = 10 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] rate_limit_burst = 0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] rate_limit_except_level = CRITICAL {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] rate_limit_interval = 0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] reinit_driver_count = 3 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] replication_device = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] report_discard_supported = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] report_interval = 120 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] reservation_clean_interval = 86400 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] reservation_expire = 86400 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] reserved_image_namespaces = [] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] reserved_percentage = 0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] rpc_response_timeout = 120 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] run_external_periodic_tasks = True {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] scst_target_driver = iscsi {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] scst_target_iqn_name = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] service_down_time = 720 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] shell_completion = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] snapshot_name_template = snapshot-%s {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] split_loggers = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] state_path = /opt/stack/data/cinder {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] storage_availability_zone = nova {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] storage_protocol = iSCSI {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] syslog_log_facility = LOG_USER {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] target_helper = lioadm {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] target_ip_address = 192.168.122.245 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] target_port = 3260 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] target_protocol = iscsi {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] target_secondary_ip_addresses = [] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] trace_flags = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] transfer_api_class = cinder.transfer.api.API {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] transport_url = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] until_refresh = 0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] use_chap_auth = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] use_default_quota_class = True {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] use_journal = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] use_json = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] use_multipath_for_image_xfer = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] use_stderr = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] use_syslog = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] verify_glance_signatures = enabled {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] volume_api_class = cinder.volume.api.API {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] volume_backend_name = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] volume_clear = zero {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] volume_clear_ionice = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] volume_clear_size = 0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] volume_copy_bps_limit = 0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] volume_dd_blocksize = 1M {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] volume_name_template = volume-%s {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] volume_service_inithost_offload = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] volume_usage_audit_period = month {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] zoning_mode = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_concurrency.disable_process_locking = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.auth_section = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.auth_type = password {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.auth_version = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.cache = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.certfile = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.delay_auth_decision = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.http_connect_timeout = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.include_service_catalog = True {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.insecure = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.interface = public {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.keyfile = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.memcache_password = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.memcache_username = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.region_name = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.service_token_roles_required = True {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87639) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 09 18:10:14 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.quobyte [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.service_type = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.quobyte [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.token_cache_time = 300 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.245/identity {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.backend = dogpile.cache.null {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Running cmd (subprocess): mount.quobyte {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.backend_argument = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.backend_expiration_time = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.config_prefix = cache.oslo {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.debug_cache_backend = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.enable_retry_client = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.enable_socket_keepalive = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.enabled = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.expiration_time = 600 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.hashclient_retry_attempts = 2 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.memcache_dead_retry = 300 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.memcache_pool_maxsize = 10 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.memcache_sasl_enabled = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.password = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.proxies = [] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.redis_db = 0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.redis_sentinel_service_name = mymaster {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.redis_server = localhost:6379 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.retry_attempts = 2 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.retry_delay = 0.0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.socket_keepalive_count = 1 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.socket_keepalive_idle = 1 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.socket_keepalive_interval = 1 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.socket_timeout = 1.0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.tls_allowed_ciphers = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.tls_cafile = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.tls_certfile = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.tls_enabled = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.tls_keyfile = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cache.username = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] coordination.backend_url = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.asyncio_connection = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.asyncio_slave_connection = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.backend = sqlalchemy {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.connection = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.connection_debug = 0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.connection_parameters = {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.connection_recycle_time = 3600 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.connection_trace = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.db_inc_retry_interval = True {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.db_max_retries = 20 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.db_max_retry_interval = 10 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.db_retry_interval = 1 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.max_overflow = 50 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.max_pool_size = 5 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.max_retries = 10 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.mysql_wsrep_sync_wait = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.pool_timeout = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.retry_interval = 10 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.slave_connection = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.sqlite_synchronous = True {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.synchronous_reader = True {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] database.use_db_reconnect = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_tracing.insecure = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] profiler.connection_string = messaging:// {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] profiler.enabled = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] profiler.es_doc_type = notification {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] profiler.es_scroll_size = 10000 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] profiler.es_scroll_time = 2m {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] profiler.filter_error_trace = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] profiler.hmac_keys = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] profiler.sentinel_service_name = mymaster {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] profiler.socket_timeout = 0.1 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] profiler.trace_requests = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] profiler.trace_sqlalchemy = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] profiler_jaeger.process_tags = {} {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] profiler_jaeger.service_name_prefix = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] profiler_otlp.service_name_prefix = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_policy.enforce_new_defaults = True {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_policy.policy_default_rule = default {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_policy.policy_file = policy.yaml {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_policy.remote_timeout = 60.0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] privsep_osbrick.group = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] privsep_osbrick.helper_command = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] privsep_osbrick.user = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cinder_sys_admin.group = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cinder_sys_admin.helper_command = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] cinder_sys_admin.user = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] service_user.auth_section = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] service_user.auth_type = password {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] service_user.cafile = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] service_user.certfile = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] service_user.collect_timing = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] service_user.insecure = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] service_user.keyfile = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] service_user.send_service_user_token = True {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] service_user.split_loggers = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] service_user.timeout = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] service_user.tls_ciphers = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] service_user.tls_min_version = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] glance.auth_section = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] glance.auth_type = password {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] glance.certfile = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] glance.collect_timing = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] glance.insecure = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] glance.keyfile = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] glance.region_name = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] glance.split_loggers = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] glance.timeout = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] glance.tls_ciphers = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] glance.tls_min_version = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.backend_availability_zone = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.chap_password = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.chap_username = {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.disk_geometry = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.driver_client_cert = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.driver_client_cert_key = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.driver_data_namespace = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.driver_use_ssl = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.enable_unsupported_driver = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.extra_capabilities = {} {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.filter_function = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.goodness_function = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.iscsi_target_flags = {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.iscsi_write_cache = on {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.iser_helper = tgtadm {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.iser_ip_address = 192.168.122.245 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack quobyte-client[87640]: Reading configuration file: /etc/quobyte/client.cfg Sep 09 18:10:14 devstack quobyte-client[87640]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.iser_port = 3260 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.nas_host = {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.nas_login = admin {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.nas_mount_options = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.nas_password = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.nas_private_key = {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.nas_share_path = {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.nas_ssh_port = 22 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] CMD "mount.quobyte" returned: 1 in 0.058s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.num_shell_tries = 3 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.nvmet_port_id = 1 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.quobyte_client_cfg = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.quobyte_volume_url = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.replication_device = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.report_discard_supported = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.reserved_percentage = 0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.scst_target_driver = iscsi {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.scst_target_iqn_name = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.storage_protocol = iSCSI {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.target_helper = tgtadm {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.target_ip_address = 192.168.122.245 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.target_port = 3260 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.target_protocol = iscsi {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.trace_flags = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.unique_fqdn_network = True {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.use_chap_auth = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.volume_backend_name = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.volume_clear = zero {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.volume_clear_ionice = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.volume_clear_size = 0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_reports.file_event_handler = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_reports.log_dir = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.backend_availability_zone = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.backend_host = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.chap_password = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.chap_username = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.chiscsi_conf = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.disk_geometry = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.driver_client_cert = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.driver_client_cert_key = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.driver_data_namespace = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.driver_use_ssl = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.extra_capabilities = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.filter_function = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.goodness_function = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.iscsi_target_flags = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.iscsi_write_cache = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.iser_helper = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.iser_ip_address = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.iser_port = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.iser_target_prefix = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.nas_host = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.nas_login = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.nas_mount_options = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.nas_password = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.nas_private_key = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.nas_share_path = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.nas_ssh_port = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.num_shell_tries = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.nvmet_ns_id = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.nvmet_port_id = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.replication_device = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.report_discard_supported = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.reserved_percentage = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.scst_target_driver = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.storage_protocol = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.target_helper = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.target_ip_address = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.target_port = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack sudo[87641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.target_prefix = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.target_protocol = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.trace_flags = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.unique_fqdn_network = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.use_chap_auth = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.volume_clear = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.volume_clear_ionice = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.volume_clear_size = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] QuobyteHD.volumes_dir = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.ssl = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.ssl_version = {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_notifications.driver = [] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_notifications.retry = -1 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] oslo_messaging_notifications.transport_url = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] key_manager.fixed_key = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican.barbican_api_version = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican.barbican_endpoint = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican.barbican_endpoint_type = public {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican.barbican_region_name = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican.cafile = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican.certfile = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican.collect_timing = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican.insecure = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican.keyfile = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican.number_of_retries = 60 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican.retry_delay = 1 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican.send_service_user_token = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican.split_loggers = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican.timeout = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican.tls_ciphers = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican.tls_min_version = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican.verify_ssl = True {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican.verify_ssl_path = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican_service_user.auth_section = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican_service_user.auth_type = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican_service_user.cafile = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican_service_user.certfile = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican_service_user.collect_timing = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican_service_user.insecure = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican_service_user.keyfile = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican_service_user.split_loggers = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican_service_user.timeout = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican_service_user.tls_ciphers = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] barbican_service_user.tls_min_version = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] vault.approle_role_id = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] vault.approle_secret_id = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] vault.auth_method = approle {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] vault.auth_path = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] vault.kv_mountpoint = secret {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] vault.kv_path = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] vault.kv_version = 2 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] vault.namespace = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] vault.root_token_id = **** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] vault.ssl_ca_crt_file = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] vault.timeout = 60.0 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] vault.token_file = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] vault.token_role = None {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] vault.use_ssl = False {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 18:10:14 devstack cinder-volume[87329]: DEBUG oslo_service.backend._eventlet.service [None req-4b55904c-16a9-419f-95dd-79e888c39c3d None None] ******************************************************************************** {{(pid=87329) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 09 18:10:14 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.236s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:10:14 devstack cinder-volume[87639]: INFO cinder.volume.driver [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Driver hasn't implemented _init_vendor_properties() Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG cinder.volume.driver [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.32279586792, 'free_capacity_gb': 1773.32279586792, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87639) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG oslo_db.sqlalchemy.engines [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87639) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writer thread running {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG cinder.db.api [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Building query based on filter {{(pid=87639) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87639) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:10:14 devstack cinder-volume[87639]: INFO cinder.keymgr.migration [None req-31188bc9-2fc7-4474-ac47-b7a097e0d1b3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 09 18:10:14 devstack sudo[87652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:10:14 devstack sudo[87652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:10:14 devstack sudo[87652]: pam_unix(sudo:session): session closed for user root Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.237s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:10:14 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Driver initialization completed successfully. Sep 09 18:10:14 devstack cinder-volume[87639]: INFO cinder.manager [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Initiating service 3 cleanup Sep 09 18:10:14 devstack cinder-volume[87639]: INFO cinder.manager [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Service 3 cleanup completed. Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG cinder.service [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Creating RPC server for service cinder-volume {{(pid=87639) start /opt/stack/cinder/cinder/service.py:231}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG cinder.service [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87639) start /opt/stack/cinder/cinder/service.py:237}} Sep 09 18:10:14 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:10:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:10:14 devstack sudo[87666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:10:14 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:10:15 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root Sep 09 18:10:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.250s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:10:15 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-b369192c-2d34-4781-8c98-764268d4de71 None None] Driver post RPC initialization completed successfully. Sep 09 18:10:23 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:10:24 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:10:25 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=3 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:10:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:10:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 6 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:10:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:11:11 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:11:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Flow 'volume_create_manager' (e24e0b04-351c-4cea-b89c-adcf9d99c33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:11:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c67a549-c9e1-425c-8f91-c9644f4e235e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:11:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c67a549-c9e1-425c-8f91-c9644f4e235e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1189573308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c08818-3785-4b67-aec9-6624e8f03107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7910b23099e48118fb2ff3794fc9c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:11:12Z,use_quota=True,user_id='403951bc889b4d00a2ea382ef11cd822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:11:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc5c2ea-f1dd-4f22-a55a-50f1077657e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:11:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc5c2ea-f1dd-4f22-a55a-50f1077657e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:11:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d7ebf9-6ae0-4ba9-9a61-7b24cce43c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:11:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d7ebf9-6ae0-4ba9-9a61-7b24cce43c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75c08818-3785-4b67-aec9-6624e8f03107', 'volume_name': 'volume-75c08818-3785-4b67-aec9-6624e8f03107', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:11:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd96308-bd46-4579-a009-e23e75af0a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:11:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cd96308-bd46-4579-a009-e23e75af0a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:11:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e63c4f-e178-499f-94ac-5d896bdf18cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:11:11 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Volume 75c08818-3785-4b67-aec9-6624e8f03107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75c08818-3785-4b67-aec9-6624e8f03107', 'volume_size': 1} Sep 09 18:11:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:11:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:11:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1189573308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c08818-3785-4b67-aec9-6624e8f03107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7910b23099e48118fb2ff3794fc9c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:11:12Z,use_quota=True,user_id='403951bc889b4d00a2ea382ef11cd822',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:11:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Creating volume 75c08818-3785-4b67-aec9-6624e8f03107 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:11:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:11:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:11:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:11:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:11:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:11:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:11:11 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:11:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75c08818-3785-4b67-aec9-6624e8f03107 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:11:11 devstack sudo[88016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75c08818-3785-4b67-aec9-6624e8f03107 1073741824 Sep 09 18:11:11 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:11:12 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root Sep 09 18:11:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75c08818-3785-4b67-aec9-6624e8f03107 1073741824" returned: 0 in 0.554s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:11:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75c08818-3785-4b67-aec9-6624e8f03107 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:11:12 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75c08818-3785-4b67-aec9-6624e8f03107 Sep 09 18:11:12 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:11:12 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Sep 09 18:11:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75c08818-3785-4b67-aec9-6624e8f03107" returned: 0 in 0.317s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:11:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:11:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:11:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1e63c4f-e178-499f-94ac-5d896bdf18cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75c08818-3785-4b67-aec9-6624e8f03107', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:11:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de92ec53-c899-40df-8d6b-a6276123ec1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:11:12 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Volume volume-75c08818-3785-4b67-aec9-6624e8f03107 (75c08818-3785-4b67-aec9-6624e8f03107): created successfully Sep 09 18:11:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de92ec53-c899-40df-8d6b-a6276123ec1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:11:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Flow 'volume_create_manager' (e24e0b04-351c-4cea-b89c-adcf9d99c33a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:11:12 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-b58c425b-bb65-421f-bc3f-ca8867f97b11 tempest-TaggedAttachmentsTest-2042761084 None] Created volume successfully. Sep 09 18:11:22 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:11:22 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:DELETE=1 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:11:28 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:11:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Flow 'volume_create_manager' (e8513fbb-a541-45e4-a03d-8f02695ed700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:11:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5b21e2-db93-4bd7-abf4-1bce07ca6bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:11:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5b21e2-db93-4bd7-abf4-1bce07ca6bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1568690128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709cff04-97b6-40d9-af69-923ded2402d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ad22d07312a48399ee0fbbe023dcc4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:11:28Z,use_quota=True,user_id='4f2e5829090f41789ba6ad836cf43b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:11:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc8d2e01-9f7d-4bf2-a4c2-7c46d0cb1505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:11:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc8d2e01-9f7d-4bf2-a4c2-7c46d0cb1505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:11:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b703730-1b8c-467a-9443-27d0e525f7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:11:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b703730-1b8c-467a-9443-27d0e525f7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '709cff04-97b6-40d9-af69-923ded2402d2', 'volume_name': 'volume-709cff04-97b6-40d9-af69-923ded2402d2', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:11:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6004e6f-b277-44f2-8ac1-2e566fa3cd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:11:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6004e6f-b277-44f2-8ac1-2e566fa3cd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:11:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83dc98c-bf11-45b9-b348-0a40f3349f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:11:28 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Volume 709cff04-97b6-40d9-af69-923ded2402d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-709cff04-97b6-40d9-af69-923ded2402d2', 'volume_size': 1} Sep 09 18:11:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:11:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:11:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1568690128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709cff04-97b6-40d9-af69-923ded2402d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ad22d07312a48399ee0fbbe023dcc4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:11:28Z,use_quota=True,user_id='4f2e5829090f41789ba6ad836cf43b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:11:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Creating volume 709cff04-97b6-40d9-af69-923ded2402d2 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:11:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:11:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:11:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:11:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:11:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:11:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:11:28 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:11:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-709cff04-97b6-40d9-af69-923ded2402d2 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:11:28 devstack sudo[88510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-709cff04-97b6-40d9-af69-923ded2402d2 1073741824 Sep 09 18:11:28 devstack sudo[88510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:11:29 devstack sudo[88510]: pam_unix(sudo:session): session closed for user root Sep 09 18:11:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-709cff04-97b6-40d9-af69-923ded2402d2 1073741824" returned: 0 in 0.658s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:11:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-709cff04-97b6-40d9-af69-923ded2402d2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:11:29 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-709cff04-97b6-40d9-af69-923ded2402d2 Sep 09 18:11:29 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:11:29 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Sep 09 18:11:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-709cff04-97b6-40d9-af69-923ded2402d2" returned: 0 in 0.408s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:11:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:11:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:11:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83dc98c-bf11-45b9-b348-0a40f3349f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-709cff04-97b6-40d9-af69-923ded2402d2', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:11:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b15e7ab6-fc83-43cb-bc06-d43d5f434bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:11:29 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Volume volume-709cff04-97b6-40d9-af69-923ded2402d2 (709cff04-97b6-40d9-af69-923ded2402d2): created successfully Sep 09 18:11:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b15e7ab6-fc83-43cb-bc06-d43d5f434bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:11:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Flow 'volume_create_manager' (e8513fbb-a541-45e4-a03d-8f02695ed700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:11:29 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-90b4ceb1-d25b-4452-aec5-4fd6b43c271a tempest-DeleteServersTestJSON-411701593 None] Created volume successfully. Sep 09 18:11:35 devstack cinder-volume[87639]: WARNING py.warnings [req-78780dd8-876e-4d00-a5b6-be72c7e83a16 req-5744a244-20e4-4a60-8314-8d63368f9236 tempest-DeleteServersTestJSON-411701593 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 09 18:11:35 devstack cinder-volume[87639]: .first() Sep 09 18:11:35 devstack cinder-volume[87639]: Sep 09 18:11:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-78780dd8-876e-4d00-a5b6-be72c7e83a16 req-5744a244-20e4-4a60-8314-8d63368f9236 tempest-DeleteServersTestJSON-411701593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:11:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-78780dd8-876e-4d00-a5b6-be72c7e83a16 req-5744a244-20e4-4a60-8314-8d63368f9236 tempest-DeleteServersTestJSON-411701593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:11:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-78780dd8-876e-4d00-a5b6-be72c7e83a16 req-5744a244-20e4-4a60-8314-8d63368f9236 tempest-DeleteServersTestJSON-411701593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:11:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-78780dd8-876e-4d00-a5b6-be72c7e83a16 req-5744a244-20e4-4a60-8314-8d63368f9236 tempest-DeleteServersTestJSON-411701593 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-709cff04-97b6-40d9-af69-923ded2402d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4878752-b21d-49a1-b5ac-1854400bab9b', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:11:35 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-78780dd8-876e-4d00-a5b6-be72c7e83a16 req-5744a244-20e4-4a60-8314-8d63368f9236 tempest-DeleteServersTestJSON-411701593 None] attachment_update completed successfully. Sep 09 18:11:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:11:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:11:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:11:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:11:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:11:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:11:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:11:43 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:11:43 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:11:43 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Sep 09 18:11:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.273s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:11:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:11:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:11:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 6 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:11:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:11:45 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=8,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:11:45 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9,cinder:INSERT=1 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:12:25 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=1 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:12:25 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:UPDATE=1 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:12:28 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-0079c2a2-1260-419f-8a17-20d2a5755546 req-8bf2826d-68f8-412b-b905-03a8de6e7f0f tempest-DeleteServersTestJSON-411701593 None] Terminate volume connection completed successfully. Sep 09 18:12:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-0079c2a2-1260-419f-8a17-20d2a5755546 req-8bf2826d-68f8-412b-b905-03a8de6e7f0f tempest-DeleteServersTestJSON-411701593 None] Deleting attachment c4878752-b21d-49a1-b5ac-1854400bab9b. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:12:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] Acquiring lock "cinder-709cff04-97b6-40d9-af69-923ded2402d2-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:12:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] Lock "cinder-709cff04-97b6-40d9-af69-923ded2402d2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:12:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] Acquiring lock "cinder-quobyte-709cff04-97b6-40d9-af69-923ded2402d2" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:12:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] Lock "cinder-quobyte-709cff04-97b6-40d9-af69-923ded2402d2" acquired by "delete_volume" :: waited 0.056s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:12:31 devstack cinder-volume[87639]: INFO oslo.privsep.daemon [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpzxlflip_/privsep.sock'] Sep 09 18:12:31 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpzxlflip_/privsep.sock Sep 09 18:12:31 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:12:33 devstack cinder-volume[87639]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 09 18:12:33 devstack cinder-volume[87639]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 09 18:12:33 devstack cinder-volume[87639]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 09 18:12:33 devstack cinder-volume[87639]: WARNING oslo.privsep.daemon [-] privsep log: Sep 09 18:12:33 devstack cinder-volume[87639]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 09 18:12:33 devstack cinder-volume[87639]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 09 18:12:33 devstack cinder-volume[87639]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 09 18:12:33 devstack cinder-volume[87639]: WARNING oslo.privsep.daemon [-] privsep log: Sep 09 18:12:33 devstack cinder-volume[87639]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 09 18:12:34 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Sep 09 18:12:34 devstack cinder-volume[87639]: INFO oslo.privsep.daemon [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] Spawned new privsep daemon via rootwrap Sep 09 18:12:34 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] Accepted privsep connection to /tmp/tmpzxlflip_/privsep.sock {{(pid=87639) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 09 18:12:34 devstack cinder-volume[87639]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 09 18:12:34 devstack cinder-volume[87639]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 09 18:12:34 devstack cinder-volume[87639]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 09 18:12:34 devstack cinder-volume[87639]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89535 Sep 09 18:12:34 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e183c7d8-4088-4ebc-bdde-046cbf545f95]: (2,) {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:12:34 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[286bdf28-ee3a-447c-92b6-6ed9659489fe]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:12:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-709cff04-97b6-40d9-af69-923ded2402d2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:12:34 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-709cff04-97b6-40d9-af69-923ded2402d2 Sep 09 18:12:34 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:12:34 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Sep 09 18:12:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-709cff04-97b6-40d9-af69-923ded2402d2" returned: 0 in 0.618s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:12:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-709cff04-97b6-40d9-af69-923ded2402d2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:12:34 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-709cff04-97b6-40d9-af69-923ded2402d2 Sep 09 18:12:34 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:12:35 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Sep 09 18:12:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-709cff04-97b6-40d9-af69-923ded2402d2" returned: 0 in 0.469s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:12:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] Lock "cinder-quobyte-709cff04-97b6-40d9-af69-923ded2402d2" released by "delete_volume" :: held 3.422s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:12:35 devstack cinder-volume[87639]: WARNING cinder.quota [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:12:35 devstack cinder-volume[87639]: WARNING cinder.quota [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:12:35 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] Created reservations ['864286d3-1979-4ba8-9452-6868145f87a5', '6ece841d-fbe0-44d4-88e1-33abd2e25257', '1efe0ac9-3e44-4a42-b2f9-50b485976a71', '8dc75a2d-ff49-4c9b-8869-2abfcf0884b1'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:12:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:12:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:12:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:12:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:12:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:12:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:12:35 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:12:35 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:12:36 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Sep 09 18:12:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.512s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:12:36 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:12:36 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] Deleted volume successfully. Sep 09 18:12:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-881578a0-27ac-4dc7-965b-063b505a92ba tempest-DeleteServersTestJSON-411701593 None] Lock "cinder-709cff04-97b6-40d9-af69-923ded2402d2-delete_volume" released by "delete_volume" :: held 4.511s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:12:36 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:12:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Flow 'volume_create_manager' (39c81dc6-a18b-4bf3-a519-a49c1c7da639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:12:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22d4972-3e17-400b-862d-2d1456a21a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:12:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22d4972-3e17-400b-862d-2d1456a21a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-546808392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df767811-95d4-4588-b8da-85d82554166d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='078199c1f8544917bea052b2282fc852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:12:37Z,use_quota=True,user_id='fda2fc81482541009baf8565b6558471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:12:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaabeae1-ffc4-4245-a918-8fdb829a7210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:12:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaabeae1-ffc4-4245-a918-8fdb829a7210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:12:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (106b9889-c2ef-488e-8850-ff2d6aaf3fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:12:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (106b9889-c2ef-488e-8850-ff2d6aaf3fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df767811-95d4-4588-b8da-85d82554166d', 'volume_name': 'volume-df767811-95d4-4588-b8da-85d82554166d', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:12:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3505e785-9260-4e2e-b9ae-35ecf722c4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:12:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3505e785-9260-4e2e-b9ae-35ecf722c4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:12:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5f5f7d5-c0ce-40f8-b2c6-029d2a83a16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:12:37 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Volume df767811-95d4-4588-b8da-85d82554166d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df767811-95d4-4588-b8da-85d82554166d', 'volume_size': 1} Sep 09 18:12:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:12:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:12:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:12:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-546808392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df767811-95d4-4588-b8da-85d82554166d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='078199c1f8544917bea052b2282fc852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:12:37Z,use_quota=True,user_id='fda2fc81482541009baf8565b6558471',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:12:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Creating volume df767811-95d4-4588-b8da-85d82554166d {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:12:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:12:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:12:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:12:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:12:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:12:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:12:37 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:12:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df767811-95d4-4588-b8da-85d82554166d 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:12:37 devstack sudo[89549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df767811-95d4-4588-b8da-85d82554166d 1073741824 Sep 09 18:12:37 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:12:38 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root Sep 09 18:12:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df767811-95d4-4588-b8da-85d82554166d 1073741824" returned: 0 in 1.076s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:12:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df767811-95d4-4588-b8da-85d82554166d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:12:38 devstack sudo[89557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df767811-95d4-4588-b8da-85d82554166d Sep 09 18:12:38 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:12:38 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root Sep 09 18:12:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df767811-95d4-4588-b8da-85d82554166d" returned: 0 in 0.510s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:12:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:12:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:12:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5f5f7d5-c0ce-40f8-b2c6-029d2a83a16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df767811-95d4-4588-b8da-85d82554166d', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:12:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a3d61b-7e29-47df-b79c-b6ad23da3b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:12:38 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Volume volume-df767811-95d4-4588-b8da-85d82554166d (df767811-95d4-4588-b8da-85d82554166d): created successfully Sep 09 18:12:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a3d61b-7e29-47df-b79c-b6ad23da3b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:12:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Flow 'volume_create_manager' (39c81dc6-a18b-4bf3-a519-a49c1c7da639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:12:38 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-15873778-104d-49ea-a852-efaa2d1ff3c7 tempest-ServerRescueNegativeTestJSON-900460030 None] Created volume successfully. Sep 09 18:12:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:12:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:12:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:12:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:12:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:12:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:12:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:12:43 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:12:43 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:12:43 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Sep 09 18:12:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.333s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:12:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:12:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6c3b7f0e-ddee-434a-a794-911428cb53cd tempest-BackendsCapabilitiesAdminTestsJSON-1111968880 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.32279586792, 'free_capacity_gb': 1773.32279586792, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87639) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 09 18:12:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-69111da6-eb66-480a-b61e-e6ad9e67dd9b tempest-BackendsCapabilitiesAdminTestsJSON-1111968880 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.32279586792, 'free_capacity_gb': 1773.32279586792, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87639) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 09 18:12:48 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=7,cinder:UPDATE=14,cinder:INSERT=2 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:12:48 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=9,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=2 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:12:52 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c4d6980e-efd4-4b29-adeb-fffd01849d8e tempest-ServerRescueNegativeTestJSON-900460030 None] Acquiring lock "cinder-df767811-95d4-4588-b8da-85d82554166d-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:12:52 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c4d6980e-efd4-4b29-adeb-fffd01849d8e tempest-ServerRescueNegativeTestJSON-900460030 None] Lock "cinder-df767811-95d4-4588-b8da-85d82554166d-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:12:52 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c4d6980e-efd4-4b29-adeb-fffd01849d8e tempest-ServerRescueNegativeTestJSON-900460030 None] Acquiring lock "cinder-quobyte-df767811-95d4-4588-b8da-85d82554166d" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:12:52 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c4d6980e-efd4-4b29-adeb-fffd01849d8e tempest-ServerRescueNegativeTestJSON-900460030 None] Lock "cinder-quobyte-df767811-95d4-4588-b8da-85d82554166d" acquired by "delete_volume" :: waited 0.038s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:12:52 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4789e4cc-3447-42de-93ae-467ec6474f50]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:12:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c4d6980e-efd4-4b29-adeb-fffd01849d8e tempest-ServerRescueNegativeTestJSON-900460030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df767811-95d4-4588-b8da-85d82554166d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:12:52 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df767811-95d4-4588-b8da-85d82554166d Sep 09 18:12:52 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:12:52 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Sep 09 18:12:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c4d6980e-efd4-4b29-adeb-fffd01849d8e tempest-ServerRescueNegativeTestJSON-900460030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df767811-95d4-4588-b8da-85d82554166d" returned: 0 in 0.600s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:12:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c4d6980e-efd4-4b29-adeb-fffd01849d8e tempest-ServerRescueNegativeTestJSON-900460030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df767811-95d4-4588-b8da-85d82554166d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:12:53 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df767811-95d4-4588-b8da-85d82554166d Sep 09 18:12:53 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:12:53 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Sep 09 18:12:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c4d6980e-efd4-4b29-adeb-fffd01849d8e tempest-ServerRescueNegativeTestJSON-900460030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df767811-95d4-4588-b8da-85d82554166d" returned: 0 in 0.383s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:12:53 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c4d6980e-efd4-4b29-adeb-fffd01849d8e tempest-ServerRescueNegativeTestJSON-900460030 None] Lock "cinder-quobyte-df767811-95d4-4588-b8da-85d82554166d" released by "delete_volume" :: held 1.097s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:12:53 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-c4d6980e-efd4-4b29-adeb-fffd01849d8e tempest-ServerRescueNegativeTestJSON-900460030 None] Created reservations ['fb44e318-6469-42b4-b689-2a0a038349de', '77788be5-0ed3-405b-9c61-408a137923d8', 'ce0a3146-056d-44ad-9296-914aab39f6b8', '88fc26ed-3514-45e2-8f5e-a2c06621afec'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:12:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c4d6980e-efd4-4b29-adeb-fffd01849d8e tempest-ServerRescueNegativeTestJSON-900460030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:12:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c4d6980e-efd4-4b29-adeb-fffd01849d8e tempest-ServerRescueNegativeTestJSON-900460030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:12:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c4d6980e-efd4-4b29-adeb-fffd01849d8e tempest-ServerRescueNegativeTestJSON-900460030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:12:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c4d6980e-efd4-4b29-adeb-fffd01849d8e tempest-ServerRescueNegativeTestJSON-900460030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:12:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c4d6980e-efd4-4b29-adeb-fffd01849d8e tempest-ServerRescueNegativeTestJSON-900460030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:12:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c4d6980e-efd4-4b29-adeb-fffd01849d8e tempest-ServerRescueNegativeTestJSON-900460030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:12:53 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:12:53 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:12:54 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Sep 09 18:12:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c4d6980e-efd4-4b29-adeb-fffd01849d8e tempest-ServerRescueNegativeTestJSON-900460030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.434s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:12:54 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-c4d6980e-efd4-4b29-adeb-fffd01849d8e tempest-ServerRescueNegativeTestJSON-900460030 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:12:54 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-c4d6980e-efd4-4b29-adeb-fffd01849d8e tempest-ServerRescueNegativeTestJSON-900460030 None] Deleted volume successfully. Sep 09 18:12:54 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c4d6980e-efd4-4b29-adeb-fffd01849d8e tempest-ServerRescueNegativeTestJSON-900460030 None] Lock "cinder-df767811-95d4-4588-b8da-85d82554166d-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:12:57 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d2186c0a-feec-4d72-82fa-566c278090fa tempest-GroupSnapshotsTest-1504887174 None] Group tempest-GroupSnapshotsTest-Group-106838923: creating Sep 09 18:12:57 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d2186c0a-feec-4d72-82fa-566c278090fa tempest-GroupSnapshotsTest-1504887174 None] Group tempest-GroupSnapshotsTest-Group-106838923: created successfully Sep 09 18:12:57 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d2186c0a-feec-4d72-82fa-566c278090fa tempest-GroupSnapshotsTest-1504887174 None] Create group completed successfully. Sep 09 18:13:00 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:13:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Flow 'volume_create_manager' (80f759ed-b991-44c4-9907-aae7303f9a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:13:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd72fd7-d733-4f60-b6d5-1c852f3e6520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd72fd7-d733-4f60-b6d5-1c852f3e6520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1754810492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=207db6d7-3b15-4a10-87be-1b3380f574cc,host='devstack@QuobyteHD#QuobyteHD',id=2513fd6c-621f-4851-b171-335bc5679b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af37d0d443ea42c5bd0aa777f82c8c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:13:00Z,use_quota=True,user_id='a807ee47a46a454e82f85ad6a1f91af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c37044d8-27d8-4667-9936-b59c83eb0999),volume_type_id=c37044d8-27d8-4667-9936-b59c83eb0999)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eded6e9-fcba-4e30-95de-d5a5045820ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eded6e9-fcba-4e30-95de-d5a5045820ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a6cd09-cbd0-4105-ace1-85dcdf08ffa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a6cd09-cbd0-4105-ace1-85dcdf08ffa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2513fd6c-621f-4851-b171-335bc5679b62', 'volume_name': 'volume-2513fd6c-621f-4851-b171-335bc5679b62', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8124f8e0-63f6-4bfa-8dfd-6326580eaec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8124f8e0-63f6-4bfa-8dfd-6326580eaec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990a5b7f-cafa-46d3-9ec3-d45e0b43b04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:00 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Volume 2513fd6c-621f-4851-b171-335bc5679b62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2513fd6c-621f-4851-b171-335bc5679b62', 'volume_size': 1} Sep 09 18:13:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:13:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:13:00 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=207db6d7-3b15-4a10-87be-1b3380f574cc,created_at=2026-09-09T16:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1754810492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=207db6d7-3b15-4a10-87be-1b3380f574cc,host='devstack@QuobyteHD#QuobyteHD',id=2513fd6c-621f-4851-b171-335bc5679b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af37d0d443ea42c5bd0aa777f82c8c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:13:00Z,use_quota=True,user_id='a807ee47a46a454e82f85ad6a1f91af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c37044d8-27d8-4667-9936-b59c83eb0999),volume_type_id=c37044d8-27d8-4667-9936-b59c83eb0999)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:13:00 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Creating volume 2513fd6c-621f-4851-b171-335bc5679b62 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:13:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:13:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:13:00 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:13:00 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:13:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:13:00 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:13:00 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:13:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:00 devstack sudo[89819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62 1073741824 Sep 09 18:13:00 devstack sudo[89819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:01 devstack sudo[89819]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62 1073741824" returned: 0 in 1.031s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:01 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62 Sep 09 18:13:01 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:01 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62" returned: 0 in 0.378s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:13:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:13:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990a5b7f-cafa-46d3-9ec3-d45e0b43b04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2513fd6c-621f-4851-b171-335bc5679b62', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a22ea2-842a-4b2b-8105-4a20830d937c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:02 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Volume volume-2513fd6c-621f-4851-b171-335bc5679b62 (2513fd6c-621f-4851-b171-335bc5679b62): created successfully Sep 09 18:13:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a22ea2-842a-4b2b-8105-4a20830d937c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Flow 'volume_create_manager' (80f759ed-b991-44c4-9907-aae7303f9a60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:13:02 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-9982c070-f651-4500-8847-baddb9d9cbb0 tempest-GroupSnapshotsTest-1504887174 None] Created volume successfully. Sep 09 18:13:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-a2c73dff-9046-4723-a249-aca861ef5156 req-28157878-61f1-4a8f-8a02-dd6edc4e256f tempest-TaggedAttachmentsTest-2042761084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:13:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-a2c73dff-9046-4723-a249-aca861ef5156 req-28157878-61f1-4a8f-8a02-dd6edc4e256f tempest-TaggedAttachmentsTest-2042761084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:13:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-a2c73dff-9046-4723-a249-aca861ef5156 req-28157878-61f1-4a8f-8a02-dd6edc4e256f tempest-TaggedAttachmentsTest-2042761084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:13:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-a2c73dff-9046-4723-a249-aca861ef5156 req-28157878-61f1-4a8f-8a02-dd6edc4e256f tempest-TaggedAttachmentsTest-2042761084 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-75c08818-3785-4b67-aec9-6624e8f03107', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ece10295-fad7-4dc7-9dd8-868c161dde0b', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:13:03 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-a2c73dff-9046-4723-a249-aca861ef5156 req-28157878-61f1-4a8f-8a02-dd6edc4e256f tempest-TaggedAttachmentsTest-2042761084 None] attachment_update completed successfully. Sep 09 18:13:03 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ca893dc2-df6e-4c37-a490-3ba89714d7db tempest-GroupSnapshotsTest-1504887174 None] GroupSnapshot 0990ba18-63ef-474f-96fd-a17c8d6975e0: creating. Sep 09 18:13:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ca893dc2-df6e-4c37-a490-3ba89714d7db tempest-GroupSnapshotsTest-1504887174 None] Group snapshot 0990ba18-63ef-474f-96fd-a17c8d6975e0: creating. {{(pid=87639) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 09 18:13:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ca893dc2-df6e-4c37-a490-3ba89714d7db tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:13:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ca893dc2-df6e-4c37-a490-3ba89714d7db tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:13:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-ca893dc2-df6e-4c37-a490-3ba89714d7db tempest-GroupSnapshotsTest-1504887174 None] Creating offline snapshot 3c52cce7-ba84-4b52-b1fc-f3362840db24 of volume 2513fd6c-621f-4851-b171-335bc5679b62 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:13:03 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6944fa6c-266f-455f-8910-ef5fb8d510f7]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:13:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ca893dc2-df6e-4c37-a490-3ba89714d7db tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:03 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62 Sep 09 18:13:03 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:04 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ca893dc2-df6e-4c37-a490-3ba89714d7db tempest-GroupSnapshotsTest-1504887174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62" returned: 0 in 0.590s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ca893dc2-df6e-4c37-a490-3ba89714d7db tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:04 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24 1G Sep 09 18:13:04 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:04 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ca893dc2-df6e-4c37-a490-3ba89714d7db tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24 1G" returned: 0 in 0.584s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ca893dc2-df6e-4c37-a490-3ba89714d7db tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2513fd6c-621f-4851-b171-335bc5679b62 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:04 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2513fd6c-621f-4851-b171-335bc5679b62 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24 Sep 09 18:13:04 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:05 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ca893dc2-df6e-4c37-a490-3ba89714d7db tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2513fd6c-621f-4851-b171-335bc5679b62 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24" returned: 0 in 0.408s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:05 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-ca893dc2-df6e-4c37-a490-3ba89714d7db tempest-GroupSnapshotsTest-1504887174 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 18:13:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ca893dc2-df6e-4c37-a490-3ba89714d7db tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:05 devstack sudo[90292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24 Sep 09 18:13:05 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:05 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ca893dc2-df6e-4c37-a490-3ba89714d7db tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24" returned: 0 in 0.337s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ca893dc2-df6e-4c37-a490-3ba89714d7db tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:05 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.info Sep 09 18:13:05 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:05 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ca893dc2-df6e-4c37-a490-3ba89714d7db tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.info" returned: 0 in 0.308s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:05 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-ca893dc2-df6e-4c37-a490-3ba89714d7db tempest-GroupSnapshotsTest-1504887174 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 18:13:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ca893dc2-df6e-4c37-a490-3ba89714d7db tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:05 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.info Sep 09 18:13:05 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:06 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ca893dc2-df6e-4c37-a490-3ba89714d7db tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.info" returned: 0 in 0.281s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ca893dc2-df6e-4c37-a490-3ba89714d7db tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.605s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:13:06 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ca893dc2-df6e-4c37-a490-3ba89714d7db tempest-GroupSnapshotsTest-1504887174 None] group_snapshot 0990ba18-63ef-474f-96fd-a17c8d6975e0: created successfully Sep 09 18:13:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:13:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:13:07 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "cinder-quobyte-3c52cce7-ba84-4b52-b1fc-f3362840db24-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c" by "_create_volume_from_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:13:07 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-3c52cce7-ba84-4b52-b1fc-f3362840db24-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:13:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Creating volume aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c from snapshot 3c52cce7-ba84-4b52-b1fc-f3362840db24 {{(pid=87639) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 18:13:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:13:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:13:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:13:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:13:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:13:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:13:07 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "cinder-quobyte-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c" by "_copy_volume_from_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:13:07 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:13:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] snapshot: 3c52cce7-ba84-4b52-b1fc-f3362840db24, volume: aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c, {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 18:13:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:13:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:13:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:13:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:13:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:13:07 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6123dfef-9d44-4365-a1df-417b54a298ff]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:13:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:07 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24 Sep 09 18:13:07 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:08 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24" returned: 0 in 0.450s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2513fd6c-621f-4851-b171-335bc5679b62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:13:08 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29aee26-12d2-4d60-ba3e-ad2360ddf67c]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:13:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:08 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62 Sep 09 18:13:08 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:08 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62" returned: 0 in 0.482s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62 {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 18:13:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Creating direct copy from snapshot {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 18:13:08 devstack cinder-volume[87639]: DEBUG cinder.utils [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Path /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c not found in is_blk_device check {{(pid=87639) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 18:13:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:08 devstack sudo[90313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c Sep 09 18:13:08 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:09 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-39ab9580-93fd-4fb1-b7f2-9e9b9bd6924b req-89c1bfba-8d03-4c8f-8139-bf484019b58a tempest-TaggedAttachmentsTest-2042761084 None] Terminate volume connection completed successfully. Sep 09 18:13:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-39ab9580-93fd-4fb1-b7f2-9e9b9bd6924b req-89c1bfba-8d03-4c8f-8139-bf484019b58a tempest-TaggedAttachmentsTest-2042761084 None] Deleting attachment ece10295-fad7-4dc7-9dd8-868c161dde0b. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:13:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c" returned: 0 in 7.671s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:16 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Image conversion details: src /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62, size 1024.00 MB, duration 7.67 sec, destination /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:13:16 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Converted 1024.00 MB image at 133.47 MB/s Sep 09 18:13:16 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c is being set with open permissions: ugo+rw: NotImplementedError Sep 09 18:13:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:16 devstack sudo[90406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c Sep 09 18:13:16 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:16 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c" returned: 0 in 0.314s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c" released by "_copy_volume_from_snapshot" :: held 9.084s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:13:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-3c52cce7-ba84-4b52-b1fc-f3362840db24-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c" released by "_create_volume_from_snapshot" :: held 9.190s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:13:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.210s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:13:16 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-5c4207ad-f45c-4d54-8e8b-a3fd5b90dd6d tempest-GroupSnapshotsTest-1504887174 None] Create group from source-snapshot-0990ba18-63ef-474f-96fd-a17c8d6975e0 completed successfully. Sep 09 18:13:17 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-487565bd-21fc-4f8f-b7af-870bea3a1452 tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "cinder-quobyte-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:13:17 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-487565bd-21fc-4f8f-b7af-870bea3a1452 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c" acquired by "delete_volume" :: waited 0.037s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:13:17 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[98410ebe-dab3-47b5-9909-89a031798067]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:13:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-487565bd-21fc-4f8f-b7af-870bea3a1452 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:17 devstack sudo[90409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c Sep 09 18:13:17 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:18 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-487565bd-21fc-4f8f-b7af-870bea3a1452 tempest-GroupSnapshotsTest-1504887174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c" returned: 0 in 0.599s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-487565bd-21fc-4f8f-b7af-870bea3a1452 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:18 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c Sep 09 18:13:18 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:18 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-487565bd-21fc-4f8f-b7af-870bea3a1452 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c" returned: 0 in 0.324s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-487565bd-21fc-4f8f-b7af-870bea3a1452 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-aec6f7d3-a6bd-471f-b837-4f6ee72c3e8c" released by "delete_volume" :: held 1.008s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:13:18 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-487565bd-21fc-4f8f-b7af-870bea3a1452 tempest-GroupSnapshotsTest-1504887174 None] Created reservations ['05ce0401-18cc-483e-8ef8-3a1dff3d682c'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:13:18 devstack cinder-volume[87639]: WARNING cinder.quota [None req-487565bd-21fc-4f8f-b7af-870bea3a1452 tempest-GroupSnapshotsTest-1504887174 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-624166346 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-624166346, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:13:18 devstack cinder-volume[87639]: WARNING cinder.quota [None req-487565bd-21fc-4f8f-b7af-870bea3a1452 tempest-GroupSnapshotsTest-1504887174 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-624166346 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-624166346, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:13:18 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-487565bd-21fc-4f8f-b7af-870bea3a1452 tempest-GroupSnapshotsTest-1504887174 None] Created reservations ['1d7aab01-9582-4aa2-a9fc-74c6ea346a5d', 'a5d5a4af-0482-4a8c-a193-8d22c15fb785', 'a4946af9-f497-4210-aa97-4e3f34c0e3f3', '89894f9d-8708-439a-b63e-b03ab35336d2'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:13:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-487565bd-21fc-4f8f-b7af-870bea3a1452 tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:13:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-487565bd-21fc-4f8f-b7af-870bea3a1452 tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:13:19 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-487565bd-21fc-4f8f-b7af-870bea3a1452 tempest-GroupSnapshotsTest-1504887174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:13:19 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-487565bd-21fc-4f8f-b7af-870bea3a1452 tempest-GroupSnapshotsTest-1504887174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:13:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-487565bd-21fc-4f8f-b7af-870bea3a1452 tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:13:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-487565bd-21fc-4f8f-b7af-870bea3a1452 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:19 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:13:19 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:19 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-487565bd-21fc-4f8f-b7af-870bea3a1452 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.319s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:19 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-487565bd-21fc-4f8f-b7af-870bea3a1452 tempest-GroupSnapshotsTest-1504887174 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:13:19 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-487565bd-21fc-4f8f-b7af-870bea3a1452 tempest-GroupSnapshotsTest-1504887174 None] Delete group completed successfully. Sep 09 18:13:20 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-9261c914-6a9a-431a-a517-fec23bd06514 tempest-GroupSnapshotsTest-1504887174 None] group_snapshot 0990ba18-63ef-474f-96fd-a17c8d6975e0: deleting Sep 09 18:13:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9261c914-6a9a-431a-a517-fec23bd06514 tempest-GroupSnapshotsTest-1504887174 None] group_snapshot 0990ba18-63ef-474f-96fd-a17c8d6975e0: deleting {{(pid=87639) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 09 18:13:20 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9261c914-6a9a-431a-a517-fec23bd06514 tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "cinder-quobyte-2513fd6c-621f-4851-b171-335bc5679b62" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:13:20 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9261c914-6a9a-431a-a517-fec23bd06514 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-2513fd6c-621f-4851-b171-335bc5679b62" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:13:20 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9261c914-6a9a-431a-a517-fec23bd06514 tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "cinder-quobyte-3c52cce7-ba84-4b52-b1fc-f3362840db24" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:13:20 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9261c914-6a9a-431a-a517-fec23bd06514 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-3c52cce7-ba84-4b52-b1fc-f3362840db24" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:13:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-9261c914-6a9a-431a-a517-fec23bd06514 tempest-GroupSnapshotsTest-1504887174 None] Deleting offline snapshot 3c52cce7-ba84-4b52-b1fc-f3362840db24 of volume 2513fd6c-621f-4851-b171-335bc5679b62 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:13:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-9261c914-6a9a-431a-a517-fec23bd06514 tempest-GroupSnapshotsTest-1504887174 None] snapshot_file for this snap is: volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:13:20 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70dc603-f4dc-4e8e-b316-c32f76f32656]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:13:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9261c914-6a9a-431a-a517-fec23bd06514 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:20 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24 Sep 09 18:13:20 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:21 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9261c914-6a9a-431a-a517-fec23bd06514 tempest-GroupSnapshotsTest-1504887174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24" returned: 0 in 0.473s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-9261c914-6a9a-431a-a517-fec23bd06514 tempest-GroupSnapshotsTest-1504887174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2513fd6c-621f-4851-b171-335bc5679b62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:13:21 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48b9bf5-b352-4199-ba7b-4c5921694dd6]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:13:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9261c914-6a9a-431a-a517-fec23bd06514 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:21 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62 Sep 09 18:13:21 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:21 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9261c914-6a9a-431a-a517-fec23bd06514 tempest-GroupSnapshotsTest-1504887174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62" returned: 0 in 0.787s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9261c914-6a9a-431a-a517-fec23bd06514 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:21 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24 Sep 09 18:13:21 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:22 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9261c914-6a9a-431a-a517-fec23bd06514 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24" returned: 0 in 0.508s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9261c914-6a9a-431a-a517-fec23bd06514 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:22 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24 Sep 09 18:13:22 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:22 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9261c914-6a9a-431a-a517-fec23bd06514 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62.3c52cce7-ba84-4b52-b1fc-f3362840db24" returned: 0 in 0.352s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:22 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9261c914-6a9a-431a-a517-fec23bd06514 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-3c52cce7-ba84-4b52-b1fc-f3362840db24" released by "_delete_snapshot" :: held 2.282s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:13:22 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9261c914-6a9a-431a-a517-fec23bd06514 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-2513fd6c-621f-4851-b171-335bc5679b62" released by "delete_snapshot" :: held 2.322s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:13:22 devstack cinder-volume[87639]: WARNING cinder.quota [None req-9261c914-6a9a-431a-a517-fec23bd06514 tempest-GroupSnapshotsTest-1504887174 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-624166346 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-624166346, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:13:22 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-9261c914-6a9a-431a-a517-fec23bd06514 tempest-GroupSnapshotsTest-1504887174 None] Created reservations ['f2b434c3-d706-45e9-abe7-c3849d650b8c', '2bbe1300-dee2-4e0b-96df-dea3b7837e45', 'f6c26844-9470-4631-9a2b-fd6399cc3407', 'b996ae62-b152-4863-ba91-8f3662f27011'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:13:23 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-9261c914-6a9a-431a-a517-fec23bd06514 tempest-GroupSnapshotsTest-1504887174 None] group_snapshot 0990ba18-63ef-474f-96fd-a17c8d6975e0: deleted successfully Sep 09 18:13:24 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b7beac23-b596-4895-87f5-a190f1dd2a02 tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "cinder-quobyte-2513fd6c-621f-4851-b171-335bc5679b62" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:13:24 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b7beac23-b596-4895-87f5-a190f1dd2a02 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-2513fd6c-621f-4851-b171-335bc5679b62" acquired by "delete_volume" :: waited 0.039s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:13:24 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a105a9-3953-480c-92ad-803bcb605d86]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:13:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7beac23-b596-4895-87f5-a190f1dd2a02 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:24 devstack sudo[90499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62 Sep 09 18:13:24 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:24 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7beac23-b596-4895-87f5-a190f1dd2a02 tempest-GroupSnapshotsTest-1504887174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62" returned: 0 in 0.473s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7beac23-b596-4895-87f5-a190f1dd2a02 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:24 devstack sudo[90505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62 Sep 09 18:13:24 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:25 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7beac23-b596-4895-87f5-a190f1dd2a02 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2513fd6c-621f-4851-b171-335bc5679b62" returned: 0 in 0.329s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:25 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b7beac23-b596-4895-87f5-a190f1dd2a02 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-2513fd6c-621f-4851-b171-335bc5679b62" released by "delete_volume" :: held 0.908s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:13:25 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-b7beac23-b596-4895-87f5-a190f1dd2a02 tempest-GroupSnapshotsTest-1504887174 None] Created reservations ['c8d6f855-ca0b-494d-835b-390f8671b4ae'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:13:25 devstack cinder-volume[87639]: WARNING cinder.db.api [None req-b7beac23-b596-4895-87f5-a190f1dd2a02 tempest-GroupSnapshotsTest-1504887174 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-624166346'] Sep 09 18:13:25 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-b7beac23-b596-4895-87f5-a190f1dd2a02 tempest-GroupSnapshotsTest-1504887174 None] Created reservations ['8367270c-30bf-4eb1-9bed-9431f6a47aa6', 'af2bf090-7d0c-488c-a64c-d9515f7d9f44', '2f99d080-9b4f-4c24-a2f2-2bf3b23e11a5', '553dac59-8375-449d-b249-ac62a26ee0f0'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:13:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b7beac23-b596-4895-87f5-a190f1dd2a02 tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:13:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b7beac23-b596-4895-87f5-a190f1dd2a02 tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:13:25 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b7beac23-b596-4895-87f5-a190f1dd2a02 tempest-GroupSnapshotsTest-1504887174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:13:25 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b7beac23-b596-4895-87f5-a190f1dd2a02 tempest-GroupSnapshotsTest-1504887174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:13:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b7beac23-b596-4895-87f5-a190f1dd2a02 tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:13:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7beac23-b596-4895-87f5-a190f1dd2a02 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:25 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:13:25 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:25 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7beac23-b596-4895-87f5-a190f1dd2a02 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.305s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:25 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-b7beac23-b596-4895-87f5-a190f1dd2a02 tempest-GroupSnapshotsTest-1504887174 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:13:25 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-b7beac23-b596-4895-87f5-a190f1dd2a02 tempest-GroupSnapshotsTest-1504887174 None] Delete group completed successfully. Sep 09 18:13:26 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-71e44783-5900-41b8-8bd9-3f6b1778acfd tempest-GroupSnapshotsTest-1504887174 None] Group tempest-GroupSnapshotsTest-Group-894131080: creating Sep 09 18:13:26 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-71e44783-5900-41b8-8bd9-3f6b1778acfd tempest-GroupSnapshotsTest-1504887174 None] Group tempest-GroupSnapshotsTest-Group-894131080: created successfully Sep 09 18:13:26 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-71e44783-5900-41b8-8bd9-3f6b1778acfd tempest-GroupSnapshotsTest-1504887174 None] Create group completed successfully. Sep 09 18:13:26 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dfe97caa-118e-4803-86cf-71aaa5604d30 tempest-TaggedAttachmentsTest-2042761084 None] Acquiring lock "cinder-75c08818-3785-4b67-aec9-6624e8f03107-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:13:26 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dfe97caa-118e-4803-86cf-71aaa5604d30 tempest-TaggedAttachmentsTest-2042761084 None] Lock "cinder-75c08818-3785-4b67-aec9-6624e8f03107-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:13:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dfe97caa-118e-4803-86cf-71aaa5604d30 tempest-TaggedAttachmentsTest-2042761084 None] Acquiring lock "cinder-quobyte-75c08818-3785-4b67-aec9-6624e8f03107" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:13:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dfe97caa-118e-4803-86cf-71aaa5604d30 tempest-TaggedAttachmentsTest-2042761084 None] Lock "cinder-quobyte-75c08818-3785-4b67-aec9-6624e8f03107" acquired by "delete_volume" :: waited 0.032s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:13:27 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37b729e-0d61-4fe2-bbe8-69cdcda7d13d]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:13:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dfe97caa-118e-4803-86cf-71aaa5604d30 tempest-TaggedAttachmentsTest-2042761084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75c08818-3785-4b67-aec9-6624e8f03107 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:27 devstack sudo[90515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75c08818-3785-4b67-aec9-6624e8f03107 Sep 09 18:13:27 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:27 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dfe97caa-118e-4803-86cf-71aaa5604d30 tempest-TaggedAttachmentsTest-2042761084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75c08818-3785-4b67-aec9-6624e8f03107" returned: 0 in 0.815s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dfe97caa-118e-4803-86cf-71aaa5604d30 tempest-TaggedAttachmentsTest-2042761084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75c08818-3785-4b67-aec9-6624e8f03107 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:28 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75c08818-3785-4b67-aec9-6624e8f03107 Sep 09 18:13:28 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:28 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dfe97caa-118e-4803-86cf-71aaa5604d30 tempest-TaggedAttachmentsTest-2042761084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75c08818-3785-4b67-aec9-6624e8f03107" returned: 0 in 0.618s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:28 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dfe97caa-118e-4803-86cf-71aaa5604d30 tempest-TaggedAttachmentsTest-2042761084 None] Lock "cinder-quobyte-75c08818-3785-4b67-aec9-6624e8f03107" released by "delete_volume" :: held 1.553s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:13:28 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-dfe97caa-118e-4803-86cf-71aaa5604d30 tempest-TaggedAttachmentsTest-2042761084 None] Created reservations ['fa16efbf-afad-4df3-9e33-0d84e05251d8', '1a0978e6-cc89-4fca-a7ae-d36281a2e33f', '018cab68-9a2d-4f9d-9e44-53c4b36e54f7', '34a747a4-9f9f-4d1e-8239-b123d423b68d'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:13:28 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Flow 'volume_create_manager' (7303a8b5-565f-456a-8160-9bf72f8c5b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e04301c-aeff-4661-9e34-40fc74d4be82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e04301c-aeff-4661-9e34-40fc74d4be82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1763098444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78d135e3-172c-4250-80b6-e25d41b360cf,host='devstack@QuobyteHD#QuobyteHD',id=df01f141-527d-43dc-b92a-a1a589c0c37f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af37d0d443ea42c5bd0aa777f82c8c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:13:29Z,use_quota=True,user_id='a807ee47a46a454e82f85ad6a1f91af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f4ae36c-f051-4d50-96bc-a9af53f4cfba),volume_type_id=9f4ae36c-f051-4d50-96bc-a9af53f4cfba)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f3fc50e-fa78-4c3f-a40d-42a108376346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f3fc50e-fa78-4c3f-a40d-42a108376346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d68d2e-65d9-43b4-8995-1abdc7023c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d68d2e-65d9-43b4-8995-1abdc7023c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df01f141-527d-43dc-b92a-a1a589c0c37f', 'volume_name': 'volume-df01f141-527d-43dc-b92a-a1a589c0c37f', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3d6d93-0007-45db-8fb6-5f3d588a71a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3d6d93-0007-45db-8fb6-5f3d588a71a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e80e0f1-ca51-425d-ae07-a64ce692c890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:29 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Volume df01f141-527d-43dc-b92a-a1a589c0c37f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df01f141-527d-43dc-b92a-a1a589c0c37f', 'volume_size': 1} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=78d135e3-172c-4250-80b6-e25d41b360cf,created_at=2026-09-09T16:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1763098444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78d135e3-172c-4250-80b6-e25d41b360cf,host='devstack@QuobyteHD#QuobyteHD',id=df01f141-527d-43dc-b92a-a1a589c0c37f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af37d0d443ea42c5bd0aa777f82c8c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:13:29Z,use_quota=True,user_id='a807ee47a46a454e82f85ad6a1f91af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f4ae36c-f051-4d50-96bc-a9af53f4cfba),volume_type_id=9f4ae36c-f051-4d50-96bc-a9af53f4cfba)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Creating volume df01f141-527d-43dc-b92a-a1a589c0c37f {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:13:29 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:29 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f 1073741824 Sep 09 18:13:29 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-dfe97caa-118e-4803-86cf-71aaa5604d30 tempest-TaggedAttachmentsTest-2042761084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-dfe97caa-118e-4803-86cf-71aaa5604d30 tempest-TaggedAttachmentsTest-2042761084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-dfe97caa-118e-4803-86cf-71aaa5604d30 tempest-TaggedAttachmentsTest-2042761084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-dfe97caa-118e-4803-86cf-71aaa5604d30 tempest-TaggedAttachmentsTest-2042761084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-dfe97caa-118e-4803-86cf-71aaa5604d30 tempest-TaggedAttachmentsTest-2042761084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dfe97caa-118e-4803-86cf-71aaa5604d30 tempest-TaggedAttachmentsTest-2042761084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:29 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:13:29 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:29 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dfe97caa-118e-4803-86cf-71aaa5604d30 tempest-TaggedAttachmentsTest-2042761084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.361s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-dfe97caa-118e-4803-86cf-71aaa5604d30 tempest-TaggedAttachmentsTest-2042761084 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:13:29 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-dfe97caa-118e-4803-86cf-71aaa5604d30 tempest-TaggedAttachmentsTest-2042761084 None] Deleted volume successfully. Sep 09 18:13:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dfe97caa-118e-4803-86cf-71aaa5604d30 tempest-TaggedAttachmentsTest-2042761084 None] Lock "cinder-75c08818-3785-4b67-aec9-6624e8f03107-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:13:30 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f 1073741824" returned: 0 in 0.925s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:30 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f Sep 09 18:13:30 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:30 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f" returned: 0 in 0.474s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:30 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:13:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:13:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e80e0f1-ca51-425d-ae07-a64ce692c890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df01f141-527d-43dc-b92a-a1a589c0c37f', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f6c23bb-0e15-49b1-9073-7c29055c6dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:30 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Volume volume-df01f141-527d-43dc-b92a-a1a589c0c37f (df01f141-527d-43dc-b92a-a1a589c0c37f): created successfully Sep 09 18:13:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f6c23bb-0e15-49b1-9073-7c29055c6dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Flow 'volume_create_manager' (7303a8b5-565f-456a-8160-9bf72f8c5b76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:13:30 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-f367e715-aa07-4899-ae23-9b378fac6faa tempest-GroupSnapshotsTest-1504887174 None] Created volume successfully. Sep 09 18:13:32 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:13:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Flow 'volume_create_manager' (02897209-6b70-4e50-91a6-b1249262f39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:13:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97e4c30-bff3-4487-bacb-b05dcf8b59ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97e4c30-bff3-4487-bacb-b05dcf8b59ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2091139113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78d135e3-172c-4250-80b6-e25d41b360cf,host='devstack@QuobyteHD#QuobyteHD',id=f35746d6-3f01-445f-9675-15b865508280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af37d0d443ea42c5bd0aa777f82c8c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:13:32Z,use_quota=True,user_id='a807ee47a46a454e82f85ad6a1f91af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f4ae36c-f051-4d50-96bc-a9af53f4cfba),volume_type_id=9f4ae36c-f051-4d50-96bc-a9af53f4cfba)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8922e48e-2416-4fe6-adeb-b6f8ac9ab1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8922e48e-2416-4fe6-adeb-b6f8ac9ab1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff84148a-3fa3-4ab5-9a9b-067e58501e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff84148a-3fa3-4ab5-9a9b-067e58501e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f35746d6-3f01-445f-9675-15b865508280', 'volume_name': 'volume-f35746d6-3f01-445f-9675-15b865508280', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c6f6baf-898a-4c0b-9770-6a60262574e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c6f6baf-898a-4c0b-9770-6a60262574e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf5c9c2-5f21-44b2-8ccc-2a772de72153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:32 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Volume f35746d6-3f01-445f-9675-15b865508280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f35746d6-3f01-445f-9675-15b865508280', 'volume_size': 1} Sep 09 18:13:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:13:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:13:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=78d135e3-172c-4250-80b6-e25d41b360cf,created_at=2026-09-09T16:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2091139113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78d135e3-172c-4250-80b6-e25d41b360cf,host='devstack@QuobyteHD#QuobyteHD',id=f35746d6-3f01-445f-9675-15b865508280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af37d0d443ea42c5bd0aa777f82c8c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:13:32Z,use_quota=True,user_id='a807ee47a46a454e82f85ad6a1f91af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f4ae36c-f051-4d50-96bc-a9af53f4cfba),volume_type_id=9f4ae36c-f051-4d50-96bc-a9af53f4cfba)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:13:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Creating volume f35746d6-3f01-445f-9675-15b865508280 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:13:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:13:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:13:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:13:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:13:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:13:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:13:32 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:13:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:32 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280 1073741824 Sep 09 18:13:32 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:33 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280 1073741824" returned: 0 in 0.682s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:33 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280 Sep 09 18:13:33 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:33 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280" returned: 0 in 0.429s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:13:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:13:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf5c9c2-5f21-44b2-8ccc-2a772de72153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f35746d6-3f01-445f-9675-15b865508280', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3488bca6-39c7-4e4f-8a81-6b9397936cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:33 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Volume volume-f35746d6-3f01-445f-9675-15b865508280 (f35746d6-3f01-445f-9675-15b865508280): created successfully Sep 09 18:13:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3488bca6-39c7-4e4f-8a81-6b9397936cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Flow 'volume_create_manager' (02897209-6b70-4e50-91a6-b1249262f39f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:13:33 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-3d66781c-1175-4cd0-a1c9-597e171b9f5a tempest-GroupSnapshotsTest-1504887174 None] Created volume successfully. Sep 09 18:13:35 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-dc0bfb37-2343-4261-a85d-22f7d455152a tempest-GroupSnapshotsTest-1504887174 None] Update group completed successfully. Sep 09 18:13:36 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-f5499654-6df3-4a1f-9f58-2357f61cb062 tempest-GroupSnapshotsTest-1504887174 None] Update group completed successfully. Sep 09 18:13:38 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-badc435c-58f1-45c3-a2b2-b1df24ca3a7e tempest-GroupSnapshotsTest-1504887174 None] Update group completed successfully. Sep 09 18:13:39 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-04088414-4050-464e-a298-a662a4e362aa tempest-GroupSnapshotsTest-1504887174 None] Update group completed successfully. Sep 09 18:13:41 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] GroupSnapshot abff35df-b9c8-484a-8c3b-7808e601d233: creating. Sep 09 18:13:41 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] Group snapshot abff35df-b9c8-484a-8c3b-7808e601d233: creating. {{(pid=87639) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 09 18:13:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:13:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:13:41 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] Creating offline snapshot 4a50f4cf-b432-40eb-8c25-32f33d55ea47 of volume f35746d6-3f01-445f-9675-15b865508280 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:13:41 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a87b491-fd38-4294-8d0a-c0fdac96002c]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:13:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:41 devstack sudo[90645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280 Sep 09 18:13:41 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:42 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280" returned: 0 in 0.579s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.4a50f4cf-b432-40eb-8c25-32f33d55ea47 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:42 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.4a50f4cf-b432-40eb-8c25-32f33d55ea47 1G Sep 09 18:13:42 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:42 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.4a50f4cf-b432-40eb-8c25-32f33d55ea47 1G" returned: 0 in 0.592s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f35746d6-3f01-445f-9675-15b865508280 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.4a50f4cf-b432-40eb-8c25-32f33d55ea47 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:42 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f35746d6-3f01-445f-9675-15b865508280 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.4a50f4cf-b432-40eb-8c25-32f33d55ea47 Sep 09 18:13:42 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:43 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f35746d6-3f01-445f-9675-15b865508280 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.4a50f4cf-b432-40eb-8c25-32f33d55ea47" returned: 0 in 0.360s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:43 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.4a50f4cf-b432-40eb-8c25-32f33d55ea47 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 18:13:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.4a50f4cf-b432-40eb-8c25-32f33d55ea47 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:43 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.4a50f4cf-b432-40eb-8c25-32f33d55ea47 Sep 09 18:13:43 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:13:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:13:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:13:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:13:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:13:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:13:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:43 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:13:43 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:43 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.453s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:43 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:13:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.4a50f4cf-b432-40eb-8c25-32f33d55ea47" returned: 0 in 0.550s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:13:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 8 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:13:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:13:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:43 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.info Sep 09 18:13:43 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:44 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.info" returned: 0 in 0.456s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:44 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 18:13:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:44 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.info Sep 09 18:13:44 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:44 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.info" returned: 0 in 0.447s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.111s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:13:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:13:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:13:44 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] Creating offline snapshot e3faf22a-0d7f-452a-be03-4044287cb896 of volume df01f141-527d-43dc-b92a-a1a589c0c37f {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:13:44 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55c292d-90fd-4efe-860c-edaf16d54330]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:13:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:44 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f Sep 09 18:13:44 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:45 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f" returned: 0 in 0.608s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.e3faf22a-0d7f-452a-be03-4044287cb896 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:45 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.e3faf22a-0d7f-452a-be03-4044287cb896 1G Sep 09 18:13:45 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:45 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.e3faf22a-0d7f-452a-be03-4044287cb896 1G" returned: 0 in 0.582s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df01f141-527d-43dc-b92a-a1a589c0c37f -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.e3faf22a-0d7f-452a-be03-4044287cb896 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:45 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df01f141-527d-43dc-b92a-a1a589c0c37f -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.e3faf22a-0d7f-452a-be03-4044287cb896 Sep 09 18:13:45 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:46 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df01f141-527d-43dc-b92a-a1a589c0c37f -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.e3faf22a-0d7f-452a-be03-4044287cb896" returned: 0 in 0.430s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:46 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.e3faf22a-0d7f-452a-be03-4044287cb896 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 18:13:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.e3faf22a-0d7f-452a-be03-4044287cb896 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:46 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.e3faf22a-0d7f-452a-be03-4044287cb896 Sep 09 18:13:46 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:46 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.e3faf22a-0d7f-452a-be03-4044287cb896" returned: 0 in 0.313s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:46 devstack sudo[90783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.info Sep 09 18:13:46 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:47 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.info" returned: 0 in 0.398s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:47 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 18:13:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:47 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.info Sep 09 18:13:47 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:47 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.info" returned: 0 in 0.466s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.938s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:13:47 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-91a1c7df-f6da-49f1-a1f0-2e8783579849 tempest-GroupSnapshotsTest-1504887174 None] group_snapshot abff35df-b9c8-484a-8c3b-7808e601d233: created successfully Sep 09 18:13:48 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] group_snapshot abff35df-b9c8-484a-8c3b-7808e601d233: deleting Sep 09 18:13:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] group_snapshot abff35df-b9c8-484a-8c3b-7808e601d233: deleting {{(pid=87639) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 09 18:13:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "cinder-quobyte-f35746d6-3f01-445f-9675-15b865508280" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:13:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-f35746d6-3f01-445f-9675-15b865508280" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:13:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "cinder-quobyte-4a50f4cf-b432-40eb-8c25-32f33d55ea47" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:13:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-4a50f4cf-b432-40eb-8c25-32f33d55ea47" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:13:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Deleting offline snapshot 4a50f4cf-b432-40eb-8c25-32f33d55ea47 of volume f35746d6-3f01-445f-9675-15b865508280 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:13:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] snapshot_file for this snap is: volume-f35746d6-3f01-445f-9675-15b865508280.4a50f4cf-b432-40eb-8c25-32f33d55ea47 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:13:48 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a5419c-d06c-44df-8507-9a78ca6b8a06]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:13:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.4a50f4cf-b432-40eb-8c25-32f33d55ea47 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:48 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.4a50f4cf-b432-40eb-8c25-32f33d55ea47 Sep 09 18:13:48 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:49 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.4a50f4cf-b432-40eb-8c25-32f33d55ea47" returned: 0 in 0.638s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:49 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f35746d6-3f01-445f-9675-15b865508280(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:13:49 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f1a567-de50-4adb-b8ba-54e23b89a07d]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:13:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:49 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280 Sep 09 18:13:49 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:50 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280" returned: 0 in 0.821s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.4a50f4cf-b432-40eb-8c25-32f33d55ea47 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:50 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.4a50f4cf-b432-40eb-8c25-32f33d55ea47 Sep 09 18:13:50 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:50 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.4a50f4cf-b432-40eb-8c25-32f33d55ea47" returned: 0 in 0.698s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.4a50f4cf-b432-40eb-8c25-32f33d55ea47 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:50 devstack sudo[90824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.4a50f4cf-b432-40eb-8c25-32f33d55ea47 Sep 09 18:13:50 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:51 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280.4a50f4cf-b432-40eb-8c25-32f33d55ea47" returned: 0 in 0.919s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-4a50f4cf-b432-40eb-8c25-32f33d55ea47" released by "_delete_snapshot" :: held 3.252s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:13:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-f35746d6-3f01-445f-9675-15b865508280" released by "delete_snapshot" :: held 3.287s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:13:51 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=79,cinder:INSERT=16,cinder:UPDATE=73,cinder:DELETE=2 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:13:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "cinder-quobyte-df01f141-527d-43dc-b92a-a1a589c0c37f" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:13:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-df01f141-527d-43dc-b92a-a1a589c0c37f" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:13:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "cinder-quobyte-e3faf22a-0d7f-452a-be03-4044287cb896" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:13:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-e3faf22a-0d7f-452a-be03-4044287cb896" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:13:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Deleting offline snapshot e3faf22a-0d7f-452a-be03-4044287cb896 of volume df01f141-527d-43dc-b92a-a1a589c0c37f {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:13:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] snapshot_file for this snap is: volume-df01f141-527d-43dc-b92a-a1a589c0c37f.e3faf22a-0d7f-452a-be03-4044287cb896 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:13:51 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[87eed6d3-a077-4815-a09c-c957e20cd6a1]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:13:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.e3faf22a-0d7f-452a-be03-4044287cb896 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:51 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:UPDATE=63,cinder:SELECT=81,cinder:INSERT=13,cinder:DELETE=3 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:13:51 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Flow 'volume_create_manager' (05a2c33b-4e50-42be-b23e-db8f997915a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea58d7c-2628-4573-87b4-f90aee0a8350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea58d7c-2628-4573-87b4-f90aee0a8350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2052030710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1185262d-c09a-4cf1-b78e-f046348e49b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf533d5788404081ba232964067f7e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:13:52Z,use_quota=True,user_id='568ba44d63c946b4bda86d5077620857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7266464a-0ff6-4d20-84e7-7bdceee5bbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7266464a-0ff6-4d20-84e7-7bdceee5bbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b6f69d-9af2-4e92-a383-d5de5ccd50dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b6f69d-9af2-4e92-a383-d5de5ccd50dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1185262d-c09a-4cf1-b78e-f046348e49b5', 'volume_name': 'volume-1185262d-c09a-4cf1-b78e-f046348e49b5', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:52 devstack sudo[90832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.e3faf22a-0d7f-452a-be03-4044287cb896 Sep 09 18:13:52 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (212b23db-37b6-4e8a-b7e2-a76688766840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (212b23db-37b6-4e8a-b7e2-a76688766840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04856b0-c8c0-4cfd-a2f4-a75155e6b2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:52 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Volume 1185262d-c09a-4cf1-b78e-f046348e49b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1185262d-c09a-4cf1-b78e-f046348e49b5', 'volume_size': 1} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2052030710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1185262d-c09a-4cf1-b78e-f046348e49b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf533d5788404081ba232964067f7e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:13:52Z,use_quota=True,user_id='568ba44d63c946b4bda86d5077620857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Creating volume 1185262d-c09a-4cf1-b78e-f046348e49b5 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:13:52 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1185262d-c09a-4cf1-b78e-f046348e49b5 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:52 devstack sudo[90834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1185262d-c09a-4cf1-b78e-f046348e49b5 1073741824 Sep 09 18:13:52 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:52 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.e3faf22a-0d7f-452a-be03-4044287cb896" returned: 0 in 0.625s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df01f141-527d-43dc-b92a-a1a589c0c37f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3412d82d-9a97-4a8b-8c06-8b0bf9407dbf]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:52 devstack sudo[90844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f Sep 09 18:13:52 devstack sudo[90844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:52 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1185262d-c09a-4cf1-b78e-f046348e49b5 1073741824" returned: 0 in 0.758s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1185262d-c09a-4cf1-b78e-f046348e49b5 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:53 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1185262d-c09a-4cf1-b78e-f046348e49b5 Sep 09 18:13:53 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:53 devstack sudo[90844]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f" returned: 0 in 0.614s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.e3faf22a-0d7f-452a-be03-4044287cb896 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:53 devstack sudo[90851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.e3faf22a-0d7f-452a-be03-4044287cb896 Sep 09 18:13:53 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:53 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1185262d-c09a-4cf1-b78e-f046348e49b5" returned: 0 in 0.513s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:13:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:13:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a04856b0-c8c0-4cfd-a2f4-a75155e6b2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1185262d-c09a-4cf1-b78e-f046348e49b5', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ff8d6c-f55c-4394-a904-049df899f662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:13:53 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Volume volume-1185262d-c09a-4cf1-b78e-f046348e49b5 (1185262d-c09a-4cf1-b78e-f046348e49b5): created successfully Sep 09 18:13:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99ff8d6c-f55c-4394-a904-049df899f662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:13:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Flow 'volume_create_manager' (05a2c33b-4e50-42be-b23e-db8f997915a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:13:53 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-1ce664fa-77c6-49d8-aa4a-4c0ddb4e11f2 tempest-AttachVolumeNegativeTest-873560772 None] Created volume successfully. Sep 09 18:13:53 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.e3faf22a-0d7f-452a-be03-4044287cb896" returned: 0 in 0.479s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.e3faf22a-0d7f-452a-be03-4044287cb896 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:53 devstack sudo[90857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.e3faf22a-0d7f-452a-be03-4044287cb896 Sep 09 18:13:53 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:54 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f.e3faf22a-0d7f-452a-be03-4044287cb896" returned: 0 in 0.580s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:54 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-e3faf22a-0d7f-452a-be03-4044287cb896" released by "_delete_snapshot" :: held 2.448s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:13:54 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-df01f141-527d-43dc-b92a-a1a589c0c37f" released by "delete_snapshot" :: held 2.524s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:13:54 devstack cinder-volume[87639]: WARNING cinder.quota [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-730293172 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-730293172, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:13:54 devstack cinder-volume[87639]: WARNING cinder.quota [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-730293172 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-730293172, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:13:54 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Created reservations ['8fb8af01-2797-4873-9883-09503516582e', 'd51b4744-e3e6-4960-9d92-9cf4c776dbdd', '1ee85323-6d6d-4232-a0c4-45601e7d8f05', '74d3ebb9-04c2-4c94-ba8c-3d5c8adb855f'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:13:54 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] Created reservations ['126c0422-b169-4dae-b4e5-ce249775683f', 'fbb014ad-079c-4e8b-a45d-fc5c0a4ddcec', '5e1a02db-d819-4dd0-adf7-cc06bd673f5b', '0bded4cd-f639-40f1-a427-72a389c345cb'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:13:54 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-b483a93a-ea4f-4b77-aa08-cadff7c78fe9 tempest-GroupSnapshotsTest-1504887174 None] group_snapshot abff35df-b9c8-484a-8c3b-7808e601d233: deleted successfully Sep 09 18:13:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-5dbf026d-9c17-4801-9184-e399fcbab142 req-833e3924-0a46-4a9a-974a-46e42464bff6 tempest-AttachVolumeNegativeTest-873560772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:13:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-5dbf026d-9c17-4801-9184-e399fcbab142 req-833e3924-0a46-4a9a-974a-46e42464bff6 tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:13:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-5dbf026d-9c17-4801-9184-e399fcbab142 req-833e3924-0a46-4a9a-974a-46e42464bff6 tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:13:56 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-5dbf026d-9c17-4801-9184-e399fcbab142 req-833e3924-0a46-4a9a-974a-46e42464bff6 tempest-AttachVolumeNegativeTest-873560772 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-1185262d-c09a-4cf1-b78e-f046348e49b5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8abbcd92-7968-46b2-bfaf-f5b137b53b7f', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:13:56 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-5dbf026d-9c17-4801-9184-e399fcbab142 req-833e3924-0a46-4a9a-974a-46e42464bff6 tempest-AttachVolumeNegativeTest-873560772 None] attachment_update completed successfully. Sep 09 18:13:56 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "cinder-quobyte-df01f141-527d-43dc-b92a-a1a589c0c37f" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:13:56 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-df01f141-527d-43dc-b92a-a1a589c0c37f" acquired by "delete_volume" :: waited 0.038s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:13:57 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6daedc5f-6943-4535-a5e0-fe3c00aae99f]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:13:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:57 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f Sep 09 18:13:57 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:57 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f" returned: 0 in 0.820s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:58 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f Sep 09 18:13:58 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:58 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df01f141-527d-43dc-b92a-a1a589c0c37f" returned: 0 in 0.901s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:58 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-df01f141-527d-43dc-b92a-a1a589c0c37f" released by "delete_volume" :: held 1.943s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:13:58 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "cinder-quobyte-f35746d6-3f01-445f-9675-15b865508280" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:13:58 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-f35746d6-3f01-445f-9675-15b865508280" acquired by "delete_volume" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:13:58 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5029514-e708-44f4-ab0d-c34f825fc7a6]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:13:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:59 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280 Sep 09 18:13:59 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:13:59 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Sep 09 18:13:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280" returned: 0 in 0.751s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:13:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:13:59 devstack sudo[91382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280 Sep 09 18:13:59 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:00 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f35746d6-3f01-445f-9675-15b865508280" returned: 0 in 0.609s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-f35746d6-3f01-445f-9675-15b865508280" released by "delete_volume" :: held 1.478s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:14:00 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] Created reservations ['bc00045c-8549-4575-9c7f-150200de8a72'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:14:00 devstack cinder-volume[87639]: WARNING cinder.quota [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-730293172 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-730293172, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:14:00 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] Created reservations ['410058b2-64fa-41be-85eb-40f1aa3f7119', 'd68cefd3-001a-4803-bb0f-19e05d9efe30', '3332e711-4ba6-44a3-84eb-7d7aecc82a35', '73e474ed-995b-4d77-8aff-c1488a33f4b1'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:14:00 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] Created reservations ['65087814-7917-4c79-b8f4-28746ac316ac', '9d4052d7-2a30-4494-9e92-653f71dfa511', '72af0c63-bc91-448b-b60b-59932e183e2a', '483592ac-0437-4149-b5a1-f03b93e16099'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:14:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:14:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:14:00 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:14:00 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:14:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:14:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:00 devstack sudo[91397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:14:00 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:01 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.453s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:01 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:14:01 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d3b1e2ff-08a4-4e01-b3c0-4283069112e4 tempest-GroupSnapshotsTest-1504887174 None] Delete group completed successfully. Sep 09 18:14:01 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-6beb65d9-753c-41ee-a977-ec25d9b8e043 tempest-GroupSnapshotsTest-1504887174 None] Group tempest-GroupSnapshotsTest-Group-899567370: creating Sep 09 18:14:01 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-6beb65d9-753c-41ee-a977-ec25d9b8e043 tempest-GroupSnapshotsTest-1504887174 None] Group tempest-GroupSnapshotsTest-Group-899567370: created successfully Sep 09 18:14:01 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-6beb65d9-753c-41ee-a977-ec25d9b8e043 tempest-GroupSnapshotsTest-1504887174 None] Create group completed successfully. Sep 09 18:14:03 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:14:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Flow 'volume_create_manager' (a1c1711c-2dbe-434d-8ac2-19d9fcaf7912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:14:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd7f128-7723-4a5c-9ffb-03fc0cc7c4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd7f128-7723-4a5c-9ffb-03fc0cc7c4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-90276709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35a945d3-61af-41c2-9ed9-1212e719548c,host='devstack@QuobyteHD#QuobyteHD',id=f1f91b91-e3c9-4d21-a389-69ebc9d14fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af37d0d443ea42c5bd0aa777f82c8c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:14:04Z,use_quota=True,user_id='a807ee47a46a454e82f85ad6a1f91af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad956aa9-11c1-4103-af02-fb85f093be34),volume_type_id=ad956aa9-11c1-4103-af02-fb85f093be34)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbf7c63a-f1bc-4130-9559-b91432bb5632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbf7c63a-f1bc-4130-9559-b91432bb5632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ecb50c-8d82-4d36-bff8-9e55a2663ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ecb50c-8d82-4d36-bff8-9e55a2663ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1f91b91-e3c9-4d21-a389-69ebc9d14fe3', 'volume_name': 'volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb16193-f4a5-451a-b461-b096a6fde4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb16193-f4a5-451a-b461-b096a6fde4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00025ef2-3004-4187-85df-c7110795eb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:03 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Volume f1f91b91-e3c9-4d21-a389-69ebc9d14fe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3', 'volume_size': 1} Sep 09 18:14:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:14:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:14:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=35a945d3-61af-41c2-9ed9-1212e719548c,created_at=2026-09-09T16:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-90276709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35a945d3-61af-41c2-9ed9-1212e719548c,host='devstack@QuobyteHD#QuobyteHD',id=f1f91b91-e3c9-4d21-a389-69ebc9d14fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af37d0d443ea42c5bd0aa777f82c8c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:14:04Z,use_quota=True,user_id='a807ee47a46a454e82f85ad6a1f91af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad956aa9-11c1-4103-af02-fb85f093be34),volume_type_id=ad956aa9-11c1-4103-af02-fb85f093be34)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:14:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Creating volume f1f91b91-e3c9-4d21-a389-69ebc9d14fe3 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:14:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:14:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:14:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:14:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:14:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:14:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:14:03 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:14:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:03 devstack sudo[91417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3 1073741824 Sep 09 18:14:03 devstack sudo[91417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:04 devstack sudo[91417]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3 1073741824" returned: 0 in 0.587s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:04 devstack sudo[91424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3 Sep 09 18:14:04 devstack sudo[91424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:04 devstack sudo[91424]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3" returned: 0 in 0.266s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:04 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:14:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:14:04 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00025ef2-3004-4187-85df-c7110795eb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:04 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcea127a-904f-42df-9e3b-cdec1fc57210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:04 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Volume volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3 (f1f91b91-e3c9-4d21-a389-69ebc9d14fe3): created successfully Sep 09 18:14:04 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcea127a-904f-42df-9e3b-cdec1fc57210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:04 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Flow 'volume_create_manager' (a1c1711c-2dbe-434d-8ac2-19d9fcaf7912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:14:04 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ca13a50b-2590-4a1f-a5ea-d1c91d5b6319 tempest-GroupSnapshotsTest-1504887174 None] Created volume successfully. Sep 09 18:14:05 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-fc81c8b7-d2f7-435b-9f44-c048f903af29 tempest-GroupSnapshotsTest-1504887174 None] GroupSnapshot 3bf4ce9c-9241-4e73-b7bb-d89f85d72bfe: creating. Sep 09 18:14:05 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fc81c8b7-d2f7-435b-9f44-c048f903af29 tempest-GroupSnapshotsTest-1504887174 None] Group snapshot 3bf4ce9c-9241-4e73-b7bb-d89f85d72bfe: creating. {{(pid=87639) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 09 18:14:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fc81c8b7-d2f7-435b-9f44-c048f903af29 tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:14:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fc81c8b7-d2f7-435b-9f44-c048f903af29 tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:14:05 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-fc81c8b7-d2f7-435b-9f44-c048f903af29 tempest-GroupSnapshotsTest-1504887174 None] Creating offline snapshot 6d19604d-d717-432d-add3-ecfea39414b4 of volume f1f91b91-e3c9-4d21-a389-69ebc9d14fe3 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:14:05 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a089e0-93e7-4a8d-b8ec-a80eb0491c81]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:14:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fc81c8b7-d2f7-435b-9f44-c048f903af29 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:05 devstack sudo[91430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3 Sep 09 18:14:05 devstack sudo[91430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:06 devstack sudo[91430]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fc81c8b7-d2f7-435b-9f44-c048f903af29 tempest-GroupSnapshotsTest-1504887174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3" returned: 0 in 0.582s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fc81c8b7-d2f7-435b-9f44-c048f903af29 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.6d19604d-d717-432d-add3-ecfea39414b4 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:06 devstack sudo[91436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.6d19604d-d717-432d-add3-ecfea39414b4 1G Sep 09 18:14:06 devstack sudo[91436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:06 devstack sudo[91436]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fc81c8b7-d2f7-435b-9f44-c048f903af29 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.6d19604d-d717-432d-add3-ecfea39414b4 1G" returned: 0 in 0.681s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fc81c8b7-d2f7-435b-9f44-c048f903af29 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.6d19604d-d717-432d-add3-ecfea39414b4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:06 devstack sudo[91441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.6d19604d-d717-432d-add3-ecfea39414b4 Sep 09 18:14:06 devstack sudo[91441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:07 devstack sudo[91441]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fc81c8b7-d2f7-435b-9f44-c048f903af29 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.6d19604d-d717-432d-add3-ecfea39414b4" returned: 0 in 0.453s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:07 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-fc81c8b7-d2f7-435b-9f44-c048f903af29 tempest-GroupSnapshotsTest-1504887174 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.6d19604d-d717-432d-add3-ecfea39414b4 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 18:14:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fc81c8b7-d2f7-435b-9f44-c048f903af29 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.6d19604d-d717-432d-add3-ecfea39414b4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:07 devstack sudo[91446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.6d19604d-d717-432d-add3-ecfea39414b4 Sep 09 18:14:07 devstack sudo[91446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:07 devstack sudo[91446]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fc81c8b7-d2f7-435b-9f44-c048f903af29 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.6d19604d-d717-432d-add3-ecfea39414b4" returned: 0 in 0.371s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fc81c8b7-d2f7-435b-9f44-c048f903af29 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:07 devstack sudo[91449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.info Sep 09 18:14:07 devstack sudo[91449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:08 devstack sudo[91449]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fc81c8b7-d2f7-435b-9f44-c048f903af29 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.info" returned: 0 in 0.444s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:08 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-fc81c8b7-d2f7-435b-9f44-c048f903af29 tempest-GroupSnapshotsTest-1504887174 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fc81c8b7-d2f7-435b-9f44-c048f903af29 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:08 devstack sudo[91452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.info Sep 09 18:14:08 devstack sudo[91452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:08 devstack sudo[91452]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fc81c8b7-d2f7-435b-9f44-c048f903af29 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.info" returned: 0 in 0.490s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fc81c8b7-d2f7-435b-9f44-c048f903af29 tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.207s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Flow 'volume_create_manager' (b89f73e2-85f5-43be-a50e-71e86f35163e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89925209-d94a-4adc-ab41-e9e21682e1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89925209-d94a-4adc-ab41-e9e21682e1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-808993483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6ce8af-4a29-4234-a819-9bb56bcfacef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca452553cc784668bfcc3728b62385f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:14:09Z,use_quota=True,user_id='150cb8270fb54b39a7ad135c27e755f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f829040-c251-4b38-928a-282153ff9285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f829040-c251-4b38-928a-282153ff9285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (777ed300-0d5a-4a27-9c89-6f45dcada6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (777ed300-0d5a-4a27-9c89-6f45dcada6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e6ce8af-4a29-4234-a819-9bb56bcfacef', 'volume_name': 'volume-0e6ce8af-4a29-4234-a819-9bb56bcfacef', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c8bbbf-56d3-4e25-800b-a5ba0910504d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c8bbbf-56d3-4e25-800b-a5ba0910504d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00ca052-89da-4d70-9aa1-32f528029916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:08 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Volume 0e6ce8af-4a29-4234-a819-9bb56bcfacef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e6ce8af-4a29-4234-a819-9bb56bcfacef', 'volume_size': 1} Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-808993483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6ce8af-4a29-4234-a819-9bb56bcfacef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca452553cc784668bfcc3728b62385f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:14:09Z,use_quota=True,user_id='150cb8270fb54b39a7ad135c27e755f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Creating volume 0e6ce8af-4a29-4234-a819-9bb56bcfacef {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:14:08 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:14:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0e6ce8af-4a29-4234-a819-9bb56bcfacef 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:08 devstack sudo[91455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0e6ce8af-4a29-4234-a819-9bb56bcfacef 1073741824 Sep 09 18:14:08 devstack sudo[91455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:08 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-fc81c8b7-d2f7-435b-9f44-c048f903af29 tempest-GroupSnapshotsTest-1504887174 None] group_snapshot 3bf4ce9c-9241-4e73-b7bb-d89f85d72bfe: created successfully Sep 09 18:14:09 devstack sudo[91455]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0e6ce8af-4a29-4234-a819-9bb56bcfacef 1073741824" returned: 0 in 0.644s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0e6ce8af-4a29-4234-a819-9bb56bcfacef {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:09 devstack sudo[91464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0e6ce8af-4a29-4234-a819-9bb56bcfacef Sep 09 18:14:09 devstack sudo[91464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:09 devstack sudo[91464]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0e6ce8af-4a29-4234-a819-9bb56bcfacef" returned: 0 in 0.295s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:14:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:14:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00ca052-89da-4d70-9aa1-32f528029916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e6ce8af-4a29-4234-a819-9bb56bcfacef', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a1ec6a9-65d6-4b6a-bdd1-29d6beaf5a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:09 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Volume volume-0e6ce8af-4a29-4234-a819-9bb56bcfacef (0e6ce8af-4a29-4234-a819-9bb56bcfacef): created successfully Sep 09 18:14:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a1ec6a9-65d6-4b6a-bdd1-29d6beaf5a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Flow 'volume_create_manager' (b89f73e2-85f5-43be-a50e-71e86f35163e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:14:09 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-13a7b675-fbc6-4924-9f81-fe706382e6ea tempest-ServersNegativeTestJSON-903231340 None] Created volume successfully. Sep 09 18:14:09 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] group_snapshot 3bf4ce9c-9241-4e73-b7bb-d89f85d72bfe: deleting Sep 09 18:14:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] group_snapshot 3bf4ce9c-9241-4e73-b7bb-d89f85d72bfe: deleting {{(pid=87639) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 09 18:14:10 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "cinder-quobyte-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:14:10 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:14:10 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "cinder-quobyte-6d19604d-d717-432d-add3-ecfea39414b4" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:14:10 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-6d19604d-d717-432d-add3-ecfea39414b4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:14:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] Deleting offline snapshot 6d19604d-d717-432d-add3-ecfea39414b4 of volume f1f91b91-e3c9-4d21-a389-69ebc9d14fe3 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:14:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] snapshot_file for this snap is: volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.6d19604d-d717-432d-add3-ecfea39414b4 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:14:10 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8441094b-4195-42dc-9495-3edf8d72bd12]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:14:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.6d19604d-d717-432d-add3-ecfea39414b4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:10 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.6d19604d-d717-432d-add3-ecfea39414b4 Sep 09 18:14:10 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:10 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.6d19604d-d717-432d-add3-ecfea39414b4" returned: 0 in 0.418s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:14:10 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1deac26-aba0-47b8-91d3-287366d31f71]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:14:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:10 devstack sudo[91474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3 Sep 09 18:14:10 devstack sudo[91474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:11 devstack sudo[91474]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3" returned: 0 in 0.715s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.6d19604d-d717-432d-add3-ecfea39414b4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:11 devstack sudo[91491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.6d19604d-d717-432d-add3-ecfea39414b4 Sep 09 18:14:11 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:12 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.6d19604d-d717-432d-add3-ecfea39414b4" returned: 0 in 0.718s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.6d19604d-d717-432d-add3-ecfea39414b4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:12 devstack sudo[91516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.6d19604d-d717-432d-add3-ecfea39414b4 Sep 09 18:14:12 devstack sudo[91516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:12 devstack sudo[91516]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3.6d19604d-d717-432d-add3-ecfea39414b4" returned: 0 in 0.448s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-6d19604d-d717-432d-add3-ecfea39414b4" released by "_delete_snapshot" :: held 2.473s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:14:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3" released by "delete_snapshot" :: held 2.502s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:14:12 devstack cinder-volume[87639]: WARNING cinder.quota [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-174936285 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-174936285, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:14:12 devstack cinder-volume[87639]: WARNING cinder.quota [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-174936285 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-174936285, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:14:12 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] Created reservations ['7542ddae-c83d-4b74-bbb8-fad45e1ea57a', '2ba46265-1150-41a3-ad16-44302fdb5513', '3ebe245f-b5a1-40dd-869d-c2dfebdf0aef', 'bc070999-307a-43f3-8fe9-aaebb0f953d6'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:14:12 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-19a34d75-15d6-431e-b958-a7ba28b014c7 tempest-GroupSnapshotsTest-1504887174 None] group_snapshot 3bf4ce9c-9241-4e73-b7bb-d89f85d72bfe: deleted successfully Sep 09 18:14:13 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:14:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Flow 'volume_create_manager' (e1fa282f-3649-4aa1-a093-832368f02773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:14:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ba1bfc-a0df-4d8e-8eed-5f391193aca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ba1bfc-a0df-4d8e-8eed-5f391193aca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-709555757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca452553cc784668bfcc3728b62385f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:14:13Z,use_quota=True,user_id='150cb8270fb54b39a7ad135c27e755f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83f8af2-c34e-42ed-a7bf-033edf3028d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83f8af2-c34e-42ed-a7bf-033edf3028d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff9953f-fd41-46cd-8b24-8680cea9015a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff9953f-fd41-46cd-8b24-8680cea9015a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38', 'volume_name': 'volume-cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16dddeee-0a7f-4c86-960f-ea28d65a3546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16dddeee-0a7f-4c86-960f-ea28d65a3546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1267def-8e07-4df6-9b3b-f3c4d487ddbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:13 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Volume cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38', 'volume_size': 1} Sep 09 18:14:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:14:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:14:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-709555757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca452553cc784668bfcc3728b62385f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:14:13Z,use_quota=True,user_id='150cb8270fb54b39a7ad135c27e755f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:14:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Creating volume cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:14:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:14:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:14:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:14:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:14:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:14:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:14:13 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:14:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:13 devstack sudo[91523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38 1073741824 Sep 09 18:14:13 devstack sudo[91523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:14 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8c1ab081-2f00-481f-a393-bab9b9d4f05b tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "cinder-quobyte-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:14:14 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8c1ab081-2f00-481f-a393-bab9b9d4f05b tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3" acquired by "delete_volume" :: waited 0.031s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:14:14 devstack sudo[91523]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38 1073741824" returned: 0 in 0.676s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:14 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afc769a-ab96-4367-9347-cd938eb3c116]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:14:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8c1ab081-2f00-481f-a393-bab9b9d4f05b tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:14 devstack sudo[91534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38 Sep 09 18:14:14 devstack sudo[91534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:14 devstack sudo[91533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3 Sep 09 18:14:14 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:14 devstack sudo[91534]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38" returned: 0 in 0.350s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:14:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:14:14 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1267def-8e07-4df6-9b3b-f3c4d487ddbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:14 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b835a9-1988-4ed8-a981-431eeb66201e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:14 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Volume volume-cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38 (cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38): created successfully Sep 09 18:14:14 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b835a9-1988-4ed8-a981-431eeb66201e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:14 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Flow 'volume_create_manager' (e1fa282f-3649-4aa1-a093-832368f02773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:14:14 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-212bd660-a2c4-443a-b2e1-4adbfc8bfd77 tempest-ServersNegativeTestJSON-903231340 None] Created volume successfully. Sep 09 18:14:14 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8c1ab081-2f00-481f-a393-bab9b9d4f05b tempest-GroupSnapshotsTest-1504887174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3" returned: 0 in 0.577s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8c1ab081-2f00-481f-a393-bab9b9d4f05b tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:14 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3 Sep 09 18:14:14 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:15 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8c1ab081-2f00-481f-a393-bab9b9d4f05b tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3" returned: 0 in 0.367s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8c1ab081-2f00-481f-a393-bab9b9d4f05b tempest-GroupSnapshotsTest-1504887174 None] Lock "cinder-quobyte-f1f91b91-e3c9-4d21-a389-69ebc9d14fe3" released by "delete_volume" :: held 1.037s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:14:15 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-8c1ab081-2f00-481f-a393-bab9b9d4f05b tempest-GroupSnapshotsTest-1504887174 None] Created reservations ['7943e5e8-3dff-4ed7-8039-d4fd05ca636f'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:14:15 devstack cinder-volume[87639]: WARNING cinder.quota [None req-8c1ab081-2f00-481f-a393-bab9b9d4f05b tempest-GroupSnapshotsTest-1504887174 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-174936285 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-174936285, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:14:15 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-8c1ab081-2f00-481f-a393-bab9b9d4f05b tempest-GroupSnapshotsTest-1504887174 None] Created reservations ['8ac73960-e9e3-445b-97a3-e4784f40ae56', 'f6218549-48a9-4346-b12f-d6ed3257a833', '18d23ab9-4ca4-4925-8893-923fc235c64d', '8df493ad-bcfd-4653-a1dc-693bd5fa5fdc'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:14:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8c1ab081-2f00-481f-a393-bab9b9d4f05b tempest-GroupSnapshotsTest-1504887174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:14:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8c1ab081-2f00-481f-a393-bab9b9d4f05b tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:14:15 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8c1ab081-2f00-481f-a393-bab9b9d4f05b tempest-GroupSnapshotsTest-1504887174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:14:15 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8c1ab081-2f00-481f-a393-bab9b9d4f05b tempest-GroupSnapshotsTest-1504887174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:14:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8c1ab081-2f00-481f-a393-bab9b9d4f05b tempest-GroupSnapshotsTest-1504887174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:14:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8c1ab081-2f00-481f-a393-bab9b9d4f05b tempest-GroupSnapshotsTest-1504887174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:15 devstack sudo[91559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:14:15 devstack sudo[91559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:15 devstack sudo[91559]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8c1ab081-2f00-481f-a393-bab9b9d4f05b tempest-GroupSnapshotsTest-1504887174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.509s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:15 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-8c1ab081-2f00-481f-a393-bab9b9d4f05b tempest-GroupSnapshotsTest-1504887174 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:14:16 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-8c1ab081-2f00-481f-a393-bab9b9d4f05b tempest-GroupSnapshotsTest-1504887174 None] Delete group completed successfully. Sep 09 18:14:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dbb26ea3-38b7-4658-a547-bef9966905c5 tempest-ServersNegativeTestJSON-903231340 None] Acquiring lock "cinder-cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:14:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dbb26ea3-38b7-4658-a547-bef9966905c5 tempest-ServersNegativeTestJSON-903231340 None] Lock "cinder-cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:14:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dbb26ea3-38b7-4658-a547-bef9966905c5 tempest-ServersNegativeTestJSON-903231340 None] Acquiring lock "cinder-quobyte-cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:14:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dbb26ea3-38b7-4658-a547-bef9966905c5 tempest-ServersNegativeTestJSON-903231340 None] Lock "cinder-quobyte-cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38" acquired by "delete_volume" :: waited 0.045s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:14:16 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf57ea78-3855-45a5-902f-dbcd61b7f6f9]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:14:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dbb26ea3-38b7-4658-a547-bef9966905c5 tempest-ServersNegativeTestJSON-903231340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:16 devstack sudo[91603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38 Sep 09 18:14:16 devstack sudo[91603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:17 devstack sudo[91603]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dbb26ea3-38b7-4658-a547-bef9966905c5 tempest-ServersNegativeTestJSON-903231340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38" returned: 0 in 0.732s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dbb26ea3-38b7-4658-a547-bef9966905c5 tempest-ServersNegativeTestJSON-903231340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:17 devstack sudo[91636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38 Sep 09 18:14:17 devstack sudo[91636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:18 devstack sudo[91636]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dbb26ea3-38b7-4658-a547-bef9966905c5 tempest-ServersNegativeTestJSON-903231340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38" returned: 0 in 0.634s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dbb26ea3-38b7-4658-a547-bef9966905c5 tempest-ServersNegativeTestJSON-903231340 None] Lock "cinder-quobyte-cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38" released by "delete_volume" :: held 1.422s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:14:18 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-dbb26ea3-38b7-4658-a547-bef9966905c5 tempest-ServersNegativeTestJSON-903231340 None] Created reservations ['e41da6b0-8d93-4959-9167-d09b6a13f73f', 'e2fd2cbe-4c38-4592-b594-31ff2288cf57', 'c410ac76-95ce-4eaa-89ee-7c813b96f4a4', 'f08ab370-ed94-451b-b4ba-75fd910c87fc'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:14:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-dbb26ea3-38b7-4658-a547-bef9966905c5 tempest-ServersNegativeTestJSON-903231340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:14:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-dbb26ea3-38b7-4658-a547-bef9966905c5 tempest-ServersNegativeTestJSON-903231340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:14:18 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-dbb26ea3-38b7-4658-a547-bef9966905c5 tempest-ServersNegativeTestJSON-903231340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:14:18 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-dbb26ea3-38b7-4658-a547-bef9966905c5 tempest-ServersNegativeTestJSON-903231340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:14:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-dbb26ea3-38b7-4658-a547-bef9966905c5 tempest-ServersNegativeTestJSON-903231340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:14:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dbb26ea3-38b7-4658-a547-bef9966905c5 tempest-ServersNegativeTestJSON-903231340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:18 devstack sudo[91641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:14:18 devstack sudo[91641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:18 devstack sudo[91641]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dbb26ea3-38b7-4658-a547-bef9966905c5 tempest-ServersNegativeTestJSON-903231340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.374s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:18 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-dbb26ea3-38b7-4658-a547-bef9966905c5 tempest-ServersNegativeTestJSON-903231340 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:14:18 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-dbb26ea3-38b7-4658-a547-bef9966905c5 tempest-ServersNegativeTestJSON-903231340 None] Deleted volume successfully. Sep 09 18:14:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dbb26ea3-38b7-4658-a547-bef9966905c5 tempest-ServersNegativeTestJSON-903231340 None] Lock "cinder-cfcafbe8-04fc-41a4-a4e1-ab1cf1f13c38-delete_volume" released by "delete_volume" :: held 2.298s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:14:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-08f26339-80c7-4f0b-afdf-4a97f701b3de tempest-ServersNegativeTestJSON-903231340 None] Acquiring lock "cinder-0e6ce8af-4a29-4234-a819-9bb56bcfacef-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:14:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-08f26339-80c7-4f0b-afdf-4a97f701b3de tempest-ServersNegativeTestJSON-903231340 None] Lock "cinder-0e6ce8af-4a29-4234-a819-9bb56bcfacef-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:14:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-08f26339-80c7-4f0b-afdf-4a97f701b3de tempest-ServersNegativeTestJSON-903231340 None] Acquiring lock "cinder-quobyte-0e6ce8af-4a29-4234-a819-9bb56bcfacef" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:14:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-08f26339-80c7-4f0b-afdf-4a97f701b3de tempest-ServersNegativeTestJSON-903231340 None] Lock "cinder-quobyte-0e6ce8af-4a29-4234-a819-9bb56bcfacef" acquired by "delete_volume" :: waited 0.052s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:14:19 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d974de-2d2c-4cac-962d-b9045449d007]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:14:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-08f26339-80c7-4f0b-afdf-4a97f701b3de tempest-ServersNegativeTestJSON-903231340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0e6ce8af-4a29-4234-a819-9bb56bcfacef {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:20 devstack sudo[91693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0e6ce8af-4a29-4234-a819-9bb56bcfacef Sep 09 18:14:20 devstack sudo[91693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:20 devstack sudo[91693]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-08f26339-80c7-4f0b-afdf-4a97f701b3de tempest-ServersNegativeTestJSON-903231340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0e6ce8af-4a29-4234-a819-9bb56bcfacef" returned: 0 in 1.001s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-08f26339-80c7-4f0b-afdf-4a97f701b3de tempest-ServersNegativeTestJSON-903231340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0e6ce8af-4a29-4234-a819-9bb56bcfacef {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:20 devstack sudo[91722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0e6ce8af-4a29-4234-a819-9bb56bcfacef Sep 09 18:14:20 devstack sudo[91722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:21 devstack sudo[91722]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-08f26339-80c7-4f0b-afdf-4a97f701b3de tempest-ServersNegativeTestJSON-903231340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0e6ce8af-4a29-4234-a819-9bb56bcfacef" returned: 0 in 0.727s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-08f26339-80c7-4f0b-afdf-4a97f701b3de tempest-ServersNegativeTestJSON-903231340 None] Lock "cinder-quobyte-0e6ce8af-4a29-4234-a819-9bb56bcfacef" released by "delete_volume" :: held 1.852s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:14:21 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-08f26339-80c7-4f0b-afdf-4a97f701b3de tempest-ServersNegativeTestJSON-903231340 None] Created reservations ['15a738ce-9fe7-4103-918e-58ab0aa47843', '9264e52d-a9e2-4104-8777-c93e4f80f2bd', '8bf44a34-ca44-4a20-9ac8-b209744c2492', '2f557845-407e-45fd-84f5-ff5238a25cbf'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:14:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-08f26339-80c7-4f0b-afdf-4a97f701b3de tempest-ServersNegativeTestJSON-903231340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:14:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-08f26339-80c7-4f0b-afdf-4a97f701b3de tempest-ServersNegativeTestJSON-903231340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:14:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-08f26339-80c7-4f0b-afdf-4a97f701b3de tempest-ServersNegativeTestJSON-903231340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:14:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-08f26339-80c7-4f0b-afdf-4a97f701b3de tempest-ServersNegativeTestJSON-903231340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:14:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-08f26339-80c7-4f0b-afdf-4a97f701b3de tempest-ServersNegativeTestJSON-903231340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:14:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-08f26339-80c7-4f0b-afdf-4a97f701b3de tempest-ServersNegativeTestJSON-903231340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:21 devstack sudo[91728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:14:21 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:22 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-08f26339-80c7-4f0b-afdf-4a97f701b3de tempest-ServersNegativeTestJSON-903231340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.499s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:22 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-08f26339-80c7-4f0b-afdf-4a97f701b3de tempest-ServersNegativeTestJSON-903231340 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:14:22 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-08f26339-80c7-4f0b-afdf-4a97f701b3de tempest-ServersNegativeTestJSON-903231340 None] Deleted volume successfully. Sep 09 18:14:22 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-08f26339-80c7-4f0b-afdf-4a97f701b3de tempest-ServersNegativeTestJSON-903231340 None] Lock "cinder-0e6ce8af-4a29-4234-a819-9bb56bcfacef-delete_volume" released by "delete_volume" :: held 3.132s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:14:31 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=63,cinder:UPDATE=85,cinder:INSERT=14,cinder:DELETE=3 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:14:32 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=77,cinder:INSERT=25,cinder:UPDATE=76,cinder:DELETE=3 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:14:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:14:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:14:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:14:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:14:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:14:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:14:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:43 devstack sudo[91832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:14:43 devstack sudo[91832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:43 devstack sudo[91832]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.350s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:14:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:14:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 8 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:14:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:14:45 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:14:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Flow 'volume_create_manager' (0b615a4e-acae-409b-94c8-2fca775f647d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:14:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6688ae6-906f-48bf-81d5-2dad11efb8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6688ae6-906f-48bf-81d5-2dad11efb8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-432828470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676431be-2f02-4ade-ad26-61a613939341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4649b5697b2b47f488dcf9c0dab3176d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:14:46Z,use_quota=True,user_id='c066aaad69c84ca5b48869871ec062d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3e9110-55d6-4690-b789-cea1e9fbae2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3e9110-55d6-4690-b789-cea1e9fbae2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3257c6-83c9-4b05-8c51-5eefb74eff45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3257c6-83c9-4b05-8c51-5eefb74eff45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '676431be-2f02-4ade-ad26-61a613939341', 'volume_name': 'volume-676431be-2f02-4ade-ad26-61a613939341', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87c9bdc-0023-483f-94e6-bf96fb786fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87c9bdc-0023-483f-94e6-bf96fb786fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2011e1de-0754-48d8-a663-a91ec47d07bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:45 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Volume 676431be-2f02-4ade-ad26-61a613939341: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-676431be-2f02-4ade-ad26-61a613939341', 'volume_size': 1} Sep 09 18:14:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:14:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:14:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-432828470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676431be-2f02-4ade-ad26-61a613939341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4649b5697b2b47f488dcf9c0dab3176d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:14:46Z,use_quota=True,user_id='c066aaad69c84ca5b48869871ec062d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:14:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Creating volume 676431be-2f02-4ade-ad26-61a613939341 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:14:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:14:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:14:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:14:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:14:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:14:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:14:45 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:14:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:45 devstack sudo[91862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341 1073741824 Sep 09 18:14:45 devstack sudo[91862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:46 devstack sudo[91862]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341 1073741824" returned: 0 in 0.526s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:46 devstack sudo[91869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341 Sep 09 18:14:46 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:46 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341" returned: 0 in 0.371s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:46 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:14:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:14:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2011e1de-0754-48d8-a663-a91ec47d07bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-676431be-2f02-4ade-ad26-61a613939341', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb7e1211-0262-4195-ba73-4d899ccf7605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:46 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Volume volume-676431be-2f02-4ade-ad26-61a613939341 (676431be-2f02-4ade-ad26-61a613939341): created successfully Sep 09 18:14:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb7e1211-0262-4195-ba73-4d899ccf7605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Flow 'volume_create_manager' (0b615a4e-acae-409b-94c8-2fca775f647d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:14:46 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-888c2e32-cf33-4a4f-9a45-3745d7aeec30 tempest-SnapshotsActionsTest-497243143 None] Created volume successfully. Sep 09 18:14:47 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:14:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Flow 'volume_create_manager' (d643c50e-4661-405c-a665-60038002c3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:14:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03cfe91-9193-432b-8803-3a7567a910ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03cfe91-9193-432b-8803-3a7567a910ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-698605181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=067421d7-c8b7-4251-ac05-67bc21a2c9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b81bbb67f134a889d208be6df698c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:14:48Z,use_quota=True,user_id='f6df018fdd6c4611844893768c3b44f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757c9dc7-ff8e-4907-ba36-f7bcfcf31cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757c9dc7-ff8e-4907-ba36-f7bcfcf31cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd644808-a966-4b12-aa0e-62195480ff5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd644808-a966-4b12-aa0e-62195480ff5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '067421d7-c8b7-4251-ac05-67bc21a2c9be', 'volume_name': 'volume-067421d7-c8b7-4251-ac05-67bc21a2c9be', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a24eba-f4e7-4e1b-aaae-54fd257c5c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a24eba-f4e7-4e1b-aaae-54fd257c5c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94338963-e4a5-4966-b8f3-d070348559a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:47 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Volume 067421d7-c8b7-4251-ac05-67bc21a2c9be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-067421d7-c8b7-4251-ac05-67bc21a2c9be', 'volume_size': 1} Sep 09 18:14:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:14:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:14:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-698605181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=067421d7-c8b7-4251-ac05-67bc21a2c9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b81bbb67f134a889d208be6df698c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:14:48Z,use_quota=True,user_id='f6df018fdd6c4611844893768c3b44f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:14:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Creating volume 067421d7-c8b7-4251-ac05-67bc21a2c9be {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:14:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:14:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:14:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:14:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:14:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:14:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:14:47 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:14:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-067421d7-c8b7-4251-ac05-67bc21a2c9be 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:47 devstack sudo[91878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-067421d7-c8b7-4251-ac05-67bc21a2c9be 1073741824 Sep 09 18:14:47 devstack sudo[91878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9f71b40c-cee5-4cf0-893c-90e71c73e66e tempest-SnapshotsActionsTest-497243143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:14:48 devstack sudo[91878]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-067421d7-c8b7-4251-ac05-67bc21a2c9be 1073741824" returned: 0 in 0.569s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-067421d7-c8b7-4251-ac05-67bc21a2c9be {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:48 devstack sudo[91884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-067421d7-c8b7-4251-ac05-67bc21a2c9be Sep 09 18:14:48 devstack sudo[91884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:48 devstack sudo[91884]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-067421d7-c8b7-4251-ac05-67bc21a2c9be" returned: 0 in 0.306s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:14:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:14:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9f71b40c-cee5-4cf0-893c-90e71c73e66e tempest-SnapshotsActionsTest-497243143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.617s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:14:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-9f71b40c-cee5-4cf0-893c-90e71c73e66e tempest-SnapshotsActionsTest-497243143 None] Creating offline snapshot bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 of volume 676431be-2f02-4ade-ad26-61a613939341 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:14:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94338963-e4a5-4966-b8f3-d070348559a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-067421d7-c8b7-4251-ac05-67bc21a2c9be', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (748865ad-732d-4b41-b3ad-36118a621b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:14:48 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e4206f-a38e-444e-8d42-aed330356872]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:14:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9f71b40c-cee5-4cf0-893c-90e71c73e66e tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:48 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Volume volume-067421d7-c8b7-4251-ac05-67bc21a2c9be (067421d7-c8b7-4251-ac05-67bc21a2c9be): created successfully Sep 09 18:14:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (748865ad-732d-4b41-b3ad-36118a621b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:14:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Flow 'volume_create_manager' (d643c50e-4661-405c-a665-60038002c3c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:14:48 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-6cbb62de-58f9-428e-8b18-88853f6317e0 tempest-ServerActionsTestOtherA-1653548153 None] Created volume successfully. Sep 09 18:14:49 devstack sudo[91887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341 Sep 09 18:14:49 devstack sudo[91887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:49 devstack sudo[91887]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9f71b40c-cee5-4cf0-893c-90e71c73e66e tempest-SnapshotsActionsTest-497243143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341" returned: 0 in 0.455s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9f71b40c-cee5-4cf0-893c-90e71c73e66e tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:49 devstack sudo[91893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 1G Sep 09 18:14:49 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:49 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9f71b40c-cee5-4cf0-893c-90e71c73e66e tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 1G" returned: 0 in 0.505s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9f71b40c-cee5-4cf0-893c-90e71c73e66e tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676431be-2f02-4ade-ad26-61a613939341 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:49 devstack sudo[91899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676431be-2f02-4ade-ad26-61a613939341 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 Sep 09 18:14:49 devstack sudo[91899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:50 devstack sudo[91899]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9f71b40c-cee5-4cf0-893c-90e71c73e66e tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676431be-2f02-4ade-ad26-61a613939341 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310" returned: 0 in 0.545s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:50 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-9f71b40c-cee5-4cf0-893c-90e71c73e66e tempest-SnapshotsActionsTest-497243143 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 is being set with open permissions: ugo+rw Sep 09 18:14:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9f71b40c-cee5-4cf0-893c-90e71c73e66e tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:50 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 Sep 09 18:14:50 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:50 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9f71b40c-cee5-4cf0-893c-90e71c73e66e tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310" returned: 0 in 0.363s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:50 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-c6a65d82-2560-48ff-b5c3-f8ec6bf4f6ed req-3b20bd65-5a4e-429a-8f90-e8d9ca3c3942 tempest-AttachVolumeNegativeTest-873560772 None] Terminate volume connection completed successfully. Sep 09 18:14:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-c6a65d82-2560-48ff-b5c3-f8ec6bf4f6ed req-3b20bd65-5a4e-429a-8f90-e8d9ca3c3942 tempest-AttachVolumeNegativeTest-873560772 None] Deleting attachment 8abbcd92-7968-46b2-bfaf-f5b137b53b7f. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:14:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9f71b40c-cee5-4cf0-893c-90e71c73e66e tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:50 devstack sudo[91913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.info Sep 09 18:14:50 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:51 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9f71b40c-cee5-4cf0-893c-90e71c73e66e tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.info" returned: 0 in 0.329s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:51 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-9f71b40c-cee5-4cf0-893c-90e71c73e66e tempest-SnapshotsActionsTest-497243143 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.info is being set with open permissions: ugo+rw Sep 09 18:14:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9f71b40c-cee5-4cf0-893c-90e71c73e66e tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:51 devstack sudo[91916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.info Sep 09 18:14:51 devstack sudo[91916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:51 devstack sudo[91916]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9f71b40c-cee5-4cf0-893c-90e71c73e66e tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.info" returned: 0 in 0.344s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9f71b40c-cee5-4cf0-893c-90e71c73e66e tempest-SnapshotsActionsTest-497243143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.712s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:14:51 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-9f71b40c-cee5-4cf0-893c-90e71c73e66e tempest-SnapshotsActionsTest-497243143 None] Create snapshot completed successfully Sep 09 18:14:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ffbd6e2e-c612-479c-bcc0-3f6c19007662 tempest-SnapshotsActionsTest-497243143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:14:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ffbd6e2e-c612-479c-bcc0-3f6c19007662 tempest-SnapshotsActionsTest-497243143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:14:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-ffbd6e2e-c612-479c-bcc0-3f6c19007662 tempest-SnapshotsActionsTest-497243143 None] Creating offline snapshot 64014672-e71a-4c07-841d-ae8ceda4c713 of volume 676431be-2f02-4ade-ad26-61a613939341 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:14:53 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3998645c-bfd5-42f7-aca5-67e29fa78516]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:14:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ffbd6e2e-c612-479c-bcc0-3f6c19007662 tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:53 devstack sudo[91947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 Sep 09 18:14:53 devstack sudo[91947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:54 devstack sudo[91947]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ffbd6e2e-c612-479c-bcc0-3f6c19007662 tempest-SnapshotsActionsTest-497243143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310" returned: 0 in 0.570s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-ffbd6e2e-c612-479c-bcc0-3f6c19007662 tempest-SnapshotsActionsTest-497243143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676431be-2f02-4ade-ad26-61a613939341(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:14:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ffbd6e2e-c612-479c-bcc0-3f6c19007662 tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.64014672-e71a-4c07-841d-ae8ceda4c713 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:54 devstack sudo[91953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.64014672-e71a-4c07-841d-ae8ceda4c713 1G Sep 09 18:14:54 devstack sudo[91953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:54 devstack sudo[91953]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ffbd6e2e-c612-479c-bcc0-3f6c19007662 tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.64014672-e71a-4c07-841d-ae8ceda4c713 1G" returned: 0 in 0.738s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ffbd6e2e-c612-479c-bcc0-3f6c19007662 tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.64014672-e71a-4c07-841d-ae8ceda4c713 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:54 devstack sudo[91962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.64014672-e71a-4c07-841d-ae8ceda4c713 Sep 09 18:14:54 devstack sudo[91962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:55 devstack sudo[91962]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ffbd6e2e-c612-479c-bcc0-3f6c19007662 tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.64014672-e71a-4c07-841d-ae8ceda4c713" returned: 0 in 0.688s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:55 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-ffbd6e2e-c612-479c-bcc0-3f6c19007662 tempest-SnapshotsActionsTest-497243143 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.64014672-e71a-4c07-841d-ae8ceda4c713 is being set with open permissions: ugo+rw Sep 09 18:14:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ffbd6e2e-c612-479c-bcc0-3f6c19007662 tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.64014672-e71a-4c07-841d-ae8ceda4c713 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:55 devstack sudo[91986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.64014672-e71a-4c07-841d-ae8ceda4c713 Sep 09 18:14:55 devstack sudo[91986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:55 devstack sudo[91986]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ffbd6e2e-c612-479c-bcc0-3f6c19007662 tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.64014672-e71a-4c07-841d-ae8ceda4c713" returned: 0 in 0.412s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ffbd6e2e-c612-479c-bcc0-3f6c19007662 tempest-SnapshotsActionsTest-497243143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.601s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:14:56 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ffbd6e2e-c612-479c-bcc0-3f6c19007662 tempest-SnapshotsActionsTest-497243143 None] Create snapshot completed successfully Sep 09 18:14:56 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] Acquiring lock "cinder-64014672-e71a-4c07-841d-ae8ceda4c713-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:14:56 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-64014672-e71a-4c07-841d-ae8ceda4c713-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:14:56 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] Acquiring lock "cinder-quobyte-676431be-2f02-4ade-ad26-61a613939341" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:14:56 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-quobyte-676431be-2f02-4ade-ad26-61a613939341" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:14:56 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] Acquiring lock "cinder-quobyte-64014672-e71a-4c07-841d-ae8ceda4c713" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:14:56 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-quobyte-64014672-e71a-4c07-841d-ae8ceda4c713" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:14:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] Deleting offline snapshot 64014672-e71a-4c07-841d-ae8ceda4c713 of volume 676431be-2f02-4ade-ad26-61a613939341 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:14:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] snapshot_file for this snap is: volume-676431be-2f02-4ade-ad26-61a613939341.64014672-e71a-4c07-841d-ae8ceda4c713 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:14:57 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[45373a5e-e364-4104-9e7e-c244f873c3ac]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:14:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.64014672-e71a-4c07-841d-ae8ceda4c713 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:57 devstack sudo[91992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.64014672-e71a-4c07-841d-ae8ceda4c713 Sep 09 18:14:57 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:57 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.64014672-e71a-4c07-841d-ae8ceda4c713" returned: 0 in 0.516s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676431be-2f02-4ade-ad26-61a613939341(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:14:57 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3432f24-db1b-40a8-8e64-436c4aa15f43]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:14:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:57 devstack sudo[91999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 Sep 09 18:14:57 devstack sudo[91999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:58 devstack sudo[91999]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310" returned: 0 in 0.605s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:58 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676431be-2f02-4ade-ad26-61a613939341(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:14:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.64014672-e71a-4c07-841d-ae8ceda4c713 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:58 devstack sudo[92039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.64014672-e71a-4c07-841d-ae8ceda4c713 Sep 09 18:14:58 devstack sudo[92039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:58 devstack sudo[92039]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.64014672-e71a-4c07-841d-ae8ceda4c713" returned: 0 in 0.744s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.64014672-e71a-4c07-841d-ae8ceda4c713 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:14:59 devstack sudo[92062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.64014672-e71a-4c07-841d-ae8ceda4c713 Sep 09 18:14:59 devstack sudo[92062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:14:59 devstack sudo[92062]: pam_unix(sudo:session): session closed for user root Sep 09 18:14:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.64014672-e71a-4c07-841d-ae8ceda4c713" returned: 0 in 0.502s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:14:59 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-quobyte-64014672-e71a-4c07-841d-ae8ceda4c713" released by "_delete_snapshot" :: held 2.536s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:14:59 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-quobyte-676431be-2f02-4ade-ad26-61a613939341" released by "delete_snapshot" :: held 2.570s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:14:59 devstack cinder-volume[87639]: WARNING cinder.quota [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:14:59 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] Created reservations ['93639dce-3716-4af3-8f72-760c8985b012', '68b55ebf-f123-4587-a56e-1a37d73d9f64', '0d7fc57a-c073-4b6e-a5b1-8ea3ad30d6e7', '4ee6f651-28bb-42a9-b85b-4aed24d3da63'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:14:59 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] Delete snapshot completed successfully. Sep 09 18:14:59 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-60a02d0a-a750-4bd2-a8a7-f54133e0ceb9 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-64014672-e71a-4c07-841d-ae8ceda4c713-delete_snapshot" released by "delete_snapshot" :: held 2.845s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:15:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-01340afc-3f4a-48db-9bda-63cfa6139836 tempest-SnapshotsActionsTest-497243143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:15:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-01340afc-3f4a-48db-9bda-63cfa6139836 tempest-SnapshotsActionsTest-497243143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:15:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-01340afc-3f4a-48db-9bda-63cfa6139836 tempest-SnapshotsActionsTest-497243143 None] Creating offline snapshot a6fef9e6-11c6-4552-96c5-6e542ae03a1c of volume 676431be-2f02-4ade-ad26-61a613939341 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:15:01 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[009c82a8-e354-4513-aea1-f35325da0274]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:15:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-01340afc-3f4a-48db-9bda-63cfa6139836 tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:01 devstack sudo[92115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 Sep 09 18:15:01 devstack sudo[92115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:01 devstack sudo[92115]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-01340afc-3f4a-48db-9bda-63cfa6139836 tempest-SnapshotsActionsTest-497243143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310" returned: 0 in 0.723s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-01340afc-3f4a-48db-9bda-63cfa6139836 tempest-SnapshotsActionsTest-497243143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676431be-2f02-4ade-ad26-61a613939341(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:15:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-01340afc-3f4a-48db-9bda-63cfa6139836 tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.a6fef9e6-11c6-4552-96c5-6e542ae03a1c 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:01 devstack sudo[92126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.a6fef9e6-11c6-4552-96c5-6e542ae03a1c 1G Sep 09 18:15:01 devstack sudo[92126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:02 devstack sudo[92126]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-01340afc-3f4a-48db-9bda-63cfa6139836 tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.a6fef9e6-11c6-4552-96c5-6e542ae03a1c 1G" returned: 0 in 0.642s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-01340afc-3f4a-48db-9bda-63cfa6139836 tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.a6fef9e6-11c6-4552-96c5-6e542ae03a1c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:02 devstack sudo[92132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.a6fef9e6-11c6-4552-96c5-6e542ae03a1c Sep 09 18:15:02 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:03 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-01340afc-3f4a-48db-9bda-63cfa6139836 tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.a6fef9e6-11c6-4552-96c5-6e542ae03a1c" returned: 0 in 0.638s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:03 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-01340afc-3f4a-48db-9bda-63cfa6139836 tempest-SnapshotsActionsTest-497243143 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.a6fef9e6-11c6-4552-96c5-6e542ae03a1c is being set with open permissions: ugo+rw Sep 09 18:15:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-01340afc-3f4a-48db-9bda-63cfa6139836 tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.a6fef9e6-11c6-4552-96c5-6e542ae03a1c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:03 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.a6fef9e6-11c6-4552-96c5-6e542ae03a1c Sep 09 18:15:03 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:03 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-01340afc-3f4a-48db-9bda-63cfa6139836 tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.a6fef9e6-11c6-4552-96c5-6e542ae03a1c" returned: 0 in 0.454s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-01340afc-3f4a-48db-9bda-63cfa6139836 tempest-SnapshotsActionsTest-497243143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.651s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:15:03 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-01340afc-3f4a-48db-9bda-63cfa6139836 tempest-SnapshotsActionsTest-497243143 None] Create snapshot completed successfully Sep 09 18:15:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] Acquiring lock "cinder-a6fef9e6-11c6-4552-96c5-6e542ae03a1c-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:15:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-a6fef9e6-11c6-4552-96c5-6e542ae03a1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.084s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:15:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] Acquiring lock "cinder-quobyte-676431be-2f02-4ade-ad26-61a613939341" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:15:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-quobyte-676431be-2f02-4ade-ad26-61a613939341" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:15:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] Acquiring lock "cinder-quobyte-a6fef9e6-11c6-4552-96c5-6e542ae03a1c" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:15:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-quobyte-a6fef9e6-11c6-4552-96c5-6e542ae03a1c" acquired by "_delete_snapshot" :: waited 0.065s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:15:05 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] Deleting offline snapshot a6fef9e6-11c6-4552-96c5-6e542ae03a1c of volume 676431be-2f02-4ade-ad26-61a613939341 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:15:05 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] snapshot_file for this snap is: volume-676431be-2f02-4ade-ad26-61a613939341.a6fef9e6-11c6-4552-96c5-6e542ae03a1c {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:15:05 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a08b9fd-a50f-4131-9481-93343260f8d0]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:15:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.a6fef9e6-11c6-4552-96c5-6e542ae03a1c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:05 devstack sudo[92203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.a6fef9e6-11c6-4552-96c5-6e542ae03a1c Sep 09 18:15:05 devstack sudo[92203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:06 devstack sudo[92203]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.a6fef9e6-11c6-4552-96c5-6e542ae03a1c" returned: 0 in 1.063s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676431be-2f02-4ade-ad26-61a613939341(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:15:06 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[56290e23-29ef-4f6d-9a61-02f49486a9fe]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:15:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:06 devstack sudo[92221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 Sep 09 18:15:06 devstack sudo[92221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:07 devstack sudo[92221]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310" returned: 0 in 0.794s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676431be-2f02-4ade-ad26-61a613939341(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:15:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.a6fef9e6-11c6-4552-96c5-6e542ae03a1c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:07 devstack sudo[92229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.a6fef9e6-11c6-4552-96c5-6e542ae03a1c Sep 09 18:15:07 devstack sudo[92229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:07 devstack sudo[92229]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.a6fef9e6-11c6-4552-96c5-6e542ae03a1c" returned: 0 in 0.875s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.a6fef9e6-11c6-4552-96c5-6e542ae03a1c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:08 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.a6fef9e6-11c6-4552-96c5-6e542ae03a1c Sep 09 18:15:08 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:08 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.a6fef9e6-11c6-4552-96c5-6e542ae03a1c" returned: 0 in 0.656s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:08 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-quobyte-a6fef9e6-11c6-4552-96c5-6e542ae03a1c" released by "_delete_snapshot" :: held 3.668s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:15:08 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-quobyte-676431be-2f02-4ade-ad26-61a613939341" released by "delete_snapshot" :: held 3.757s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:15:09 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] Created reservations ['0a49e79f-8b78-40c5-a7ba-7a7648daa270', 'd01ba715-7a50-4277-9255-9fd6176e3b43', '2e986e8c-0d78-4c1d-9248-dba9a57e4c95', 'db1e5ab7-99ef-4601-9acd-263be9e4a0ef'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:15:09 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] Delete snapshot completed successfully. Sep 09 18:15:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b91da22d-0a2f-4415-89e5-9e6cea99bcf6 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-a6fef9e6-11c6-4552-96c5-6e542ae03a1c-delete_snapshot" released by "delete_snapshot" :: held 4.295s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:15:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0b77ef8e-4240-4491-8fcc-5f699390adee tempest-SnapshotsActionsTest-497243143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:15:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0b77ef8e-4240-4491-8fcc-5f699390adee tempest-SnapshotsActionsTest-497243143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:15:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-0b77ef8e-4240-4491-8fcc-5f699390adee tempest-SnapshotsActionsTest-497243143 None] Creating offline snapshot e6fb8766-945a-47a8-8639-3ef03ca4e647 of volume 676431be-2f02-4ade-ad26-61a613939341 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:15:10 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe22250-d5db-4883-9a6c-3ec0bf94558f]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:15:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0b77ef8e-4240-4491-8fcc-5f699390adee tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:10 devstack sudo[92261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 Sep 09 18:15:10 devstack sudo[92261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:10 devstack sudo[92261]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0b77ef8e-4240-4491-8fcc-5f699390adee tempest-SnapshotsActionsTest-497243143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310" returned: 0 in 0.694s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-0b77ef8e-4240-4491-8fcc-5f699390adee tempest-SnapshotsActionsTest-497243143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676431be-2f02-4ade-ad26-61a613939341(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:15:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0b77ef8e-4240-4491-8fcc-5f699390adee tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.e6fb8766-945a-47a8-8639-3ef03ca4e647 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:10 devstack sudo[92266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.e6fb8766-945a-47a8-8639-3ef03ca4e647 1G Sep 09 18:15:10 devstack sudo[92266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:11 devstack sudo[92266]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0b77ef8e-4240-4491-8fcc-5f699390adee tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.e6fb8766-945a-47a8-8639-3ef03ca4e647 1G" returned: 0 in 0.944s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0b77ef8e-4240-4491-8fcc-5f699390adee tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.e6fb8766-945a-47a8-8639-3ef03ca4e647 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:11 devstack sudo[92271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.e6fb8766-945a-47a8-8639-3ef03ca4e647 Sep 09 18:15:11 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:12 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0b77ef8e-4240-4491-8fcc-5f699390adee tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.e6fb8766-945a-47a8-8639-3ef03ca4e647" returned: 0 in 0.761s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:12 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-0b77ef8e-4240-4491-8fcc-5f699390adee tempest-SnapshotsActionsTest-497243143 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.e6fb8766-945a-47a8-8639-3ef03ca4e647 is being set with open permissions: ugo+rw Sep 09 18:15:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0b77ef8e-4240-4491-8fcc-5f699390adee tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.e6fb8766-945a-47a8-8639-3ef03ca4e647 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:12 devstack sudo[92289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.e6fb8766-945a-47a8-8639-3ef03ca4e647 Sep 09 18:15:12 devstack sudo[92289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:13 devstack sudo[92289]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0b77ef8e-4240-4491-8fcc-5f699390adee tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.e6fb8766-945a-47a8-8639-3ef03ca4e647" returned: 0 in 1.058s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0b77ef8e-4240-4491-8fcc-5f699390adee tempest-SnapshotsActionsTest-497243143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.773s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:15:13 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-0b77ef8e-4240-4491-8fcc-5f699390adee tempest-SnapshotsActionsTest-497243143 None] Create snapshot completed successfully Sep 09 18:15:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] Acquiring lock "cinder-e6fb8766-945a-47a8-8639-3ef03ca4e647-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:15:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-e6fb8766-945a-47a8-8639-3ef03ca4e647-delete_snapshot" acquired by "delete_snapshot" :: waited 0.121s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:15:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] Acquiring lock "cinder-quobyte-676431be-2f02-4ade-ad26-61a613939341" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:15:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-quobyte-676431be-2f02-4ade-ad26-61a613939341" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:15:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] Acquiring lock "cinder-quobyte-e6fb8766-945a-47a8-8639-3ef03ca4e647" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:15:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-quobyte-e6fb8766-945a-47a8-8639-3ef03ca4e647" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:15:15 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] Deleting offline snapshot e6fb8766-945a-47a8-8639-3ef03ca4e647 of volume 676431be-2f02-4ade-ad26-61a613939341 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:15:15 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] snapshot_file for this snap is: volume-676431be-2f02-4ade-ad26-61a613939341.e6fb8766-945a-47a8-8639-3ef03ca4e647 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:15:15 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5f9995-0a19-4492-b174-72e014a0bc5b]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:15:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.e6fb8766-945a-47a8-8639-3ef03ca4e647 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:15 devstack sudo[92382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.e6fb8766-945a-47a8-8639-3ef03ca4e647 Sep 09 18:15:15 devstack sudo[92382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:16 devstack sudo[92382]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.e6fb8766-945a-47a8-8639-3ef03ca4e647" returned: 0 in 0.963s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676431be-2f02-4ade-ad26-61a613939341(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:15:16 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5706dcc-18ca-4c07-83f1-f93d0a7d1df3]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:15:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:16 devstack sudo[92402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 Sep 09 18:15:16 devstack sudo[92402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:17 devstack sudo[92402]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310" returned: 0 in 0.595s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676431be-2f02-4ade-ad26-61a613939341(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:15:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.e6fb8766-945a-47a8-8639-3ef03ca4e647 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:17 devstack sudo[92409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.e6fb8766-945a-47a8-8639-3ef03ca4e647 Sep 09 18:15:17 devstack sudo[92409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:17 devstack sudo[92409]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.e6fb8766-945a-47a8-8639-3ef03ca4e647" returned: 0 in 0.442s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.e6fb8766-945a-47a8-8639-3ef03ca4e647 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:17 devstack sudo[92415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.e6fb8766-945a-47a8-8639-3ef03ca4e647 Sep 09 18:15:17 devstack sudo[92415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:17 devstack sudo[92415]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.e6fb8766-945a-47a8-8639-3ef03ca4e647" returned: 0 in 0.279s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:17 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-quobyte-e6fb8766-945a-47a8-8639-3ef03ca4e647" released by "_delete_snapshot" :: held 2.497s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:15:17 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-quobyte-676431be-2f02-4ade-ad26-61a613939341" released by "delete_snapshot" :: held 2.538s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:15:17 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] Created reservations ['745c9536-c14b-49a6-b579-ce164c1b841a', '6a682781-57f9-4969-bd9c-8cae8b230e61', '8e264960-063c-48a6-8b68-00ea2a7c4ea5', '3099db8f-2efe-4b08-91d4-5cb6118ab0a6'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:15:18 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] Delete snapshot completed successfully. Sep 09 18:15:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-79608330-1c93-4ced-884f-ff00e40b5c88 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-e6fb8766-945a-47a8-8639-3ef03ca4e647-delete_snapshot" released by "delete_snapshot" :: held 2.792s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:15:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ad2875a6-4114-45e5-b874-143ea0c5d7b1 tempest-SnapshotsActionsTest-497243143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:15:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ad2875a6-4114-45e5-b874-143ea0c5d7b1 tempest-SnapshotsActionsTest-497243143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:15:19 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-ad2875a6-4114-45e5-b874-143ea0c5d7b1 tempest-SnapshotsActionsTest-497243143 None] Creating offline snapshot 23ec6e5a-c2be-4be3-922f-f17be1a96df9 of volume 676431be-2f02-4ade-ad26-61a613939341 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:15:19 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[984b5c46-caff-4f4f-bd40-274b81fc57d5]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:15:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ad2875a6-4114-45e5-b874-143ea0c5d7b1 tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:19 devstack sudo[92419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 Sep 09 18:15:19 devstack sudo[92419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:19 devstack sudo[92419]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ad2875a6-4114-45e5-b874-143ea0c5d7b1 tempest-SnapshotsActionsTest-497243143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310" returned: 0 in 0.572s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:19 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-ad2875a6-4114-45e5-b874-143ea0c5d7b1 tempest-SnapshotsActionsTest-497243143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676431be-2f02-4ade-ad26-61a613939341(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:15:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ad2875a6-4114-45e5-b874-143ea0c5d7b1 tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.23ec6e5a-c2be-4be3-922f-f17be1a96df9 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:19 devstack sudo[92431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.23ec6e5a-c2be-4be3-922f-f17be1a96df9 1G Sep 09 18:15:19 devstack sudo[92431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:20 devstack sudo[92431]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ad2875a6-4114-45e5-b874-143ea0c5d7b1 tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.23ec6e5a-c2be-4be3-922f-f17be1a96df9 1G" returned: 0 in 0.617s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ad2875a6-4114-45e5-b874-143ea0c5d7b1 tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.23ec6e5a-c2be-4be3-922f-f17be1a96df9 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:20 devstack sudo[92436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.23ec6e5a-c2be-4be3-922f-f17be1a96df9 Sep 09 18:15:20 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:20 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ad2875a6-4114-45e5-b874-143ea0c5d7b1 tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.23ec6e5a-c2be-4be3-922f-f17be1a96df9" returned: 0 in 0.309s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:20 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-ad2875a6-4114-45e5-b874-143ea0c5d7b1 tempest-SnapshotsActionsTest-497243143 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.23ec6e5a-c2be-4be3-922f-f17be1a96df9 is being set with open permissions: ugo+rw Sep 09 18:15:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ad2875a6-4114-45e5-b874-143ea0c5d7b1 tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.23ec6e5a-c2be-4be3-922f-f17be1a96df9 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:20 devstack sudo[92441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.23ec6e5a-c2be-4be3-922f-f17be1a96df9 Sep 09 18:15:20 devstack sudo[92441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:20 devstack sudo[92441]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ad2875a6-4114-45e5-b874-143ea0c5d7b1 tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.23ec6e5a-c2be-4be3-922f-f17be1a96df9" returned: 0 in 0.236s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ad2875a6-4114-45e5-b874-143ea0c5d7b1 tempest-SnapshotsActionsTest-497243143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:15:20 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ad2875a6-4114-45e5-b874-143ea0c5d7b1 tempest-SnapshotsActionsTest-497243143 None] Create snapshot completed successfully Sep 09 18:15:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] Acquiring lock "cinder-23ec6e5a-c2be-4be3-922f-f17be1a96df9-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:15:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-23ec6e5a-c2be-4be3-922f-f17be1a96df9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:15:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] Acquiring lock "cinder-quobyte-676431be-2f02-4ade-ad26-61a613939341" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:15:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-quobyte-676431be-2f02-4ade-ad26-61a613939341" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:15:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] Acquiring lock "cinder-quobyte-23ec6e5a-c2be-4be3-922f-f17be1a96df9" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:15:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-quobyte-23ec6e5a-c2be-4be3-922f-f17be1a96df9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:15:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] Deleting offline snapshot 23ec6e5a-c2be-4be3-922f-f17be1a96df9 of volume 676431be-2f02-4ade-ad26-61a613939341 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:15:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] snapshot_file for this snap is: volume-676431be-2f02-4ade-ad26-61a613939341.23ec6e5a-c2be-4be3-922f-f17be1a96df9 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:15:21 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[523d8103-bd3b-4449-a532-f1eb94648e9e]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:15:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.23ec6e5a-c2be-4be3-922f-f17be1a96df9 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:21 devstack sudo[92461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.23ec6e5a-c2be-4be3-922f-f17be1a96df9 Sep 09 18:15:21 devstack sudo[92461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:21 devstack sudo[92461]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.23ec6e5a-c2be-4be3-922f-f17be1a96df9" returned: 0 in 0.376s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676431be-2f02-4ade-ad26-61a613939341(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:15:21 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6980fe78-800a-4f00-93b7-0ef119b9c3c9]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:15:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:21 devstack sudo[92468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 Sep 09 18:15:21 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:22 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310" returned: 0 in 0.353s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676431be-2f02-4ade-ad26-61a613939341(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:15:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.23ec6e5a-c2be-4be3-922f-f17be1a96df9 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:22 devstack sudo[92473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.23ec6e5a-c2be-4be3-922f-f17be1a96df9 Sep 09 18:15:22 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:22 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.23ec6e5a-c2be-4be3-922f-f17be1a96df9" returned: 0 in 0.387s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.23ec6e5a-c2be-4be3-922f-f17be1a96df9 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:22 devstack sudo[92478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.23ec6e5a-c2be-4be3-922f-f17be1a96df9 Sep 09 18:15:22 devstack sudo[92478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:22 devstack sudo[92478]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.23ec6e5a-c2be-4be3-922f-f17be1a96df9" returned: 0 in 0.279s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:22 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-quobyte-23ec6e5a-c2be-4be3-922f-f17be1a96df9" released by "_delete_snapshot" :: held 1.502s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:15:22 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-quobyte-676431be-2f02-4ade-ad26-61a613939341" released by "delete_snapshot" :: held 1.527s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:15:22 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] Created reservations ['1442377b-75b2-4a66-b3f5-276233a747f9', '5a244d3a-fb72-4299-9755-b9619feb483c', '202ce3b3-6b18-4e6a-a4c5-3ddfcad8fc14', '1c61c1ce-26a6-4778-abe9-663c5b0f72ff'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:15:22 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] Delete snapshot completed successfully. Sep 09 18:15:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-610e57d9-7cbf-4131-9645-97dcd1576bc0 tempest-SnapshotsActionsTest-691534497 None] Lock "cinder-23ec6e5a-c2be-4be3-922f-f17be1a96df9-delete_snapshot" released by "delete_snapshot" :: held 1.734s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:15:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0515e687-da2b-486d-a077-690682781125 tempest-SnapshotsActionsTest-497243143 None] Acquiring lock "cinder-bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:15:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0515e687-da2b-486d-a077-690682781125 tempest-SnapshotsActionsTest-497243143 None] Lock "cinder-bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:15:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0515e687-da2b-486d-a077-690682781125 tempest-SnapshotsActionsTest-497243143 None] Acquiring lock "cinder-quobyte-676431be-2f02-4ade-ad26-61a613939341" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:15:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0515e687-da2b-486d-a077-690682781125 tempest-SnapshotsActionsTest-497243143 None] Lock "cinder-quobyte-676431be-2f02-4ade-ad26-61a613939341" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:15:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0515e687-da2b-486d-a077-690682781125 tempest-SnapshotsActionsTest-497243143 None] Acquiring lock "cinder-quobyte-bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:15:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0515e687-da2b-486d-a077-690682781125 tempest-SnapshotsActionsTest-497243143 None] Lock "cinder-quobyte-bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:15:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-0515e687-da2b-486d-a077-690682781125 tempest-SnapshotsActionsTest-497243143 None] Deleting offline snapshot bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 of volume 676431be-2f02-4ade-ad26-61a613939341 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:15:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-0515e687-da2b-486d-a077-690682781125 tempest-SnapshotsActionsTest-497243143 None] snapshot_file for this snap is: volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:15:23 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3287c2-86e6-4f76-9260-c1ae5401e074]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:15:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0515e687-da2b-486d-a077-690682781125 tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:24 devstack sudo[92481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 Sep 09 18:15:24 devstack sudo[92481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:24 devstack sudo[92481]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0515e687-da2b-486d-a077-690682781125 tempest-SnapshotsActionsTest-497243143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310" returned: 0 in 0.392s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-0515e687-da2b-486d-a077-690682781125 tempest-SnapshotsActionsTest-497243143 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-676431be-2f02-4ade-ad26-61a613939341(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:15:24 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb50cc65-ecf5-402b-9623-7959e07375c9]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:15:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0515e687-da2b-486d-a077-690682781125 tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:24 devstack sudo[92486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341 Sep 09 18:15:24 devstack sudo[92486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:24 devstack sudo[92486]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0515e687-da2b-486d-a077-690682781125 tempest-SnapshotsActionsTest-497243143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341" returned: 0 in 0.360s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0515e687-da2b-486d-a077-690682781125 tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:24 devstack sudo[92491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 Sep 09 18:15:24 devstack sudo[92491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:25 devstack sudo[92491]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0515e687-da2b-486d-a077-690682781125 tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310" returned: 0 in 0.357s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0515e687-da2b-486d-a077-690682781125 tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:25 devstack sudo[92498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310 Sep 09 18:15:25 devstack sudo[92498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:25 devstack sudo[92498]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0515e687-da2b-486d-a077-690682781125 tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341.bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310" returned: 0 in 0.253s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:25 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0515e687-da2b-486d-a077-690682781125 tempest-SnapshotsActionsTest-497243143 None] Lock "cinder-quobyte-bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310" released by "_delete_snapshot" :: held 1.470s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:15:25 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0515e687-da2b-486d-a077-690682781125 tempest-SnapshotsActionsTest-497243143 None] Lock "cinder-quobyte-676431be-2f02-4ade-ad26-61a613939341" released by "delete_snapshot" :: held 1.500s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:15:25 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-0515e687-da2b-486d-a077-690682781125 tempest-SnapshotsActionsTest-497243143 None] Created reservations ['6f0dba4f-f32c-41d6-a3c6-92a6a8f7957e', 'e62cfe75-bc58-4920-bec2-93c8e992eea8', '1a49104d-887e-4bdf-b813-11348e25e286', '2ee22868-73d1-4d9d-94d2-79315e172b51'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:15:25 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-0515e687-da2b-486d-a077-690682781125 tempest-SnapshotsActionsTest-497243143 None] Delete snapshot completed successfully. Sep 09 18:15:25 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0515e687-da2b-486d-a077-690682781125 tempest-SnapshotsActionsTest-497243143 None] Lock "cinder-bd1f5fa0-ae5b-4571-b53e-ea4bda5b2310-delete_snapshot" released by "delete_snapshot" :: held 1.646s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:15:26 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3eb1fb88-9fdb-4a98-9f3f-85726836e945 tempest-SnapshotsActionsTest-497243143 None] Acquiring lock "cinder-676431be-2f02-4ade-ad26-61a613939341-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:15:26 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3eb1fb88-9fdb-4a98-9f3f-85726836e945 tempest-SnapshotsActionsTest-497243143 None] Lock "cinder-676431be-2f02-4ade-ad26-61a613939341-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:15:26 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3eb1fb88-9fdb-4a98-9f3f-85726836e945 tempest-SnapshotsActionsTest-497243143 None] Acquiring lock "cinder-quobyte-676431be-2f02-4ade-ad26-61a613939341" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:15:26 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3eb1fb88-9fdb-4a98-9f3f-85726836e945 tempest-SnapshotsActionsTest-497243143 None] Lock "cinder-quobyte-676431be-2f02-4ade-ad26-61a613939341" acquired by "delete_volume" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:15:26 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[764781a0-119b-4269-a1d6-772c238948f3]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:15:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3eb1fb88-9fdb-4a98-9f3f-85726836e945 tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:26 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341 Sep 09 18:15:26 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:26 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3eb1fb88-9fdb-4a98-9f3f-85726836e945 tempest-SnapshotsActionsTest-497243143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341" returned: 0 in 0.400s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3eb1fb88-9fdb-4a98-9f3f-85726836e945 tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:26 devstack sudo[92507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341 Sep 09 18:15:26 devstack sudo[92507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:26 devstack sudo[92507]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3eb1fb88-9fdb-4a98-9f3f-85726836e945 tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-676431be-2f02-4ade-ad26-61a613939341" returned: 0 in 0.260s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:26 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3eb1fb88-9fdb-4a98-9f3f-85726836e945 tempest-SnapshotsActionsTest-497243143 None] Lock "cinder-quobyte-676431be-2f02-4ade-ad26-61a613939341" released by "delete_volume" :: held 0.717s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:15:27 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-3eb1fb88-9fdb-4a98-9f3f-85726836e945 tempest-SnapshotsActionsTest-497243143 None] Created reservations ['7d33977f-9a1b-461b-bf59-49a9fcbfdbdc', '48e0b032-94b6-418c-8362-dad8ba4fa60b', '7eb34813-306f-476c-b3f7-89c482b13fa4', '86f2f4fd-196d-467a-a013-a21792148f70'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:15:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3eb1fb88-9fdb-4a98-9f3f-85726836e945 tempest-SnapshotsActionsTest-497243143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:15:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3eb1fb88-9fdb-4a98-9f3f-85726836e945 tempest-SnapshotsActionsTest-497243143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:15:27 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3eb1fb88-9fdb-4a98-9f3f-85726836e945 tempest-SnapshotsActionsTest-497243143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:15:27 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3eb1fb88-9fdb-4a98-9f3f-85726836e945 tempest-SnapshotsActionsTest-497243143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:15:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3eb1fb88-9fdb-4a98-9f3f-85726836e945 tempest-SnapshotsActionsTest-497243143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:15:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3eb1fb88-9fdb-4a98-9f3f-85726836e945 tempest-SnapshotsActionsTest-497243143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:27 devstack sudo[92510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:15:27 devstack sudo[92510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:27 devstack sudo[92510]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3eb1fb88-9fdb-4a98-9f3f-85726836e945 tempest-SnapshotsActionsTest-497243143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.248s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:27 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-3eb1fb88-9fdb-4a98-9f3f-85726836e945 tempest-SnapshotsActionsTest-497243143 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:15:27 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-3eb1fb88-9fdb-4a98-9f3f-85726836e945 tempest-SnapshotsActionsTest-497243143 None] Deleted volume successfully. Sep 09 18:15:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3eb1fb88-9fdb-4a98-9f3f-85726836e945 tempest-SnapshotsActionsTest-497243143 None] Lock "cinder-676431be-2f02-4ade-ad26-61a613939341-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:15:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-6168bbc1-dbfc-4f7b-a707-56bdea23494b req-566a5753-6d0f-46a0-8976-9d097e4e8a14 tempest-ServerActionsTestOtherA-1653548153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:15:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-6168bbc1-dbfc-4f7b-a707-56bdea23494b req-566a5753-6d0f-46a0-8976-9d097e4e8a14 tempest-ServerActionsTestOtherA-1653548153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:15:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-6168bbc1-dbfc-4f7b-a707-56bdea23494b req-566a5753-6d0f-46a0-8976-9d097e4e8a14 tempest-ServerActionsTestOtherA-1653548153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:15:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-6168bbc1-dbfc-4f7b-a707-56bdea23494b req-566a5753-6d0f-46a0-8976-9d097e4e8a14 tempest-ServerActionsTestOtherA-1653548153 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-067421d7-c8b7-4251-ac05-67bc21a2c9be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56964e31-f900-4c34-a5d9-50213e331ed1', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:15:30 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-6168bbc1-dbfc-4f7b-a707-56bdea23494b req-566a5753-6d0f-46a0-8976-9d097e4e8a14 tempest-ServerActionsTestOtherA-1653548153 None] attachment_update completed successfully. Sep 09 18:15:33 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:15:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Flow 'volume_create_manager' (c5d19d57-9b74-438d-b52c-4a104ac646b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:15:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3499308-fb2a-44e5-a057-a7f726876011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3499308-fb2a-44e5-a057-a7f726876011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-102666456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c15160-8414-4072-9bb6-f935e7599a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6376f7bc6384e9e9f35ec7a7aae8a35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:15:34Z,use_quota=True,user_id='7761a50254f741fd890e4d4a80c159a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:15:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed03213c-120f-4776-b675-3f69b4c52e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed03213c-120f-4776-b675-3f69b4c52e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:15:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bba25dc8-bc3e-48b5-acc6-7e69c6de4630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bba25dc8-bc3e-48b5-acc6-7e69c6de4630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13c15160-8414-4072-9bb6-f935e7599a89', 'volume_name': 'volume-13c15160-8414-4072-9bb6-f935e7599a89', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:15:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3452a51a-2398-4d02-bab2-20b9b36cea25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3452a51a-2398-4d02-bab2-20b9b36cea25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:15:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22fa0da7-b9c7-4ffa-be0e-bfafa27b8da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:33 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Volume 13c15160-8414-4072-9bb6-f935e7599a89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13c15160-8414-4072-9bb6-f935e7599a89', 'volume_size': 1} Sep 09 18:15:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:15:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:15:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-102666456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c15160-8414-4072-9bb6-f935e7599a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6376f7bc6384e9e9f35ec7a7aae8a35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:15:34Z,use_quota=True,user_id='7761a50254f741fd890e4d4a80c159a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:15:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Creating volume 13c15160-8414-4072-9bb6-f935e7599a89 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:15:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:15:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:15:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:15:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:15:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:15:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:15:33 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:15:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-13c15160-8414-4072-9bb6-f935e7599a89 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:33 devstack sudo[92941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-13c15160-8414-4072-9bb6-f935e7599a89 1073741824 Sep 09 18:15:33 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:34 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-7a6e571c-a961-427b-b924-507a2a5b0fe3 req-56372a99-05f2-4b29-b064-cd51ff9639b8 tempest-ServerActionsTestOtherA-1653548153 None] Terminate volume connection completed successfully. Sep 09 18:15:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-7a6e571c-a961-427b-b924-507a2a5b0fe3 req-56372a99-05f2-4b29-b064-cd51ff9639b8 tempest-ServerActionsTestOtherA-1653548153 None] Deleting attachment 56964e31-f900-4c34-a5d9-50213e331ed1. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:15:34 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-13c15160-8414-4072-9bb6-f935e7599a89 1073741824" returned: 0 in 0.582s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-13c15160-8414-4072-9bb6-f935e7599a89 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:34 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-13c15160-8414-4072-9bb6-f935e7599a89 Sep 09 18:15:34 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:34 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-13c15160-8414-4072-9bb6-f935e7599a89" returned: 0 in 0.518s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:15:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:15:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22fa0da7-b9c7-4ffa-be0e-bfafa27b8da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13c15160-8414-4072-9bb6-f935e7599a89', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:15:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7fcccb4-fc95-4cc4-bbed-1ba3c9acd50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:35 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Volume volume-13c15160-8414-4072-9bb6-f935e7599a89 (13c15160-8414-4072-9bb6-f935e7599a89): created successfully Sep 09 18:15:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7fcccb4-fc95-4cc4-bbed-1ba3c9acd50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:15:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Flow 'volume_create_manager' (c5d19d57-9b74-438d-b52c-4a104ac646b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:15:35 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-71f0f637-8986-45cd-bb3e-d6aa8a2e97e7 tempest-AttachVolumeShelveTestJSON-1650110475 None] Created volume successfully. Sep 09 18:15:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-7a6e571c-a961-427b-b924-507a2a5b0fe3 req-03cffea1-1afd-4557-a362-5b87da2a66f8 tempest-ServerActionsTestOtherA-1653548153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:15:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-7a6e571c-a961-427b-b924-507a2a5b0fe3 req-03cffea1-1afd-4557-a362-5b87da2a66f8 tempest-ServerActionsTestOtherA-1653548153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:15:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-7a6e571c-a961-427b-b924-507a2a5b0fe3 req-03cffea1-1afd-4557-a362-5b87da2a66f8 tempest-ServerActionsTestOtherA-1653548153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:15:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-7a6e571c-a961-427b-b924-507a2a5b0fe3 req-03cffea1-1afd-4557-a362-5b87da2a66f8 tempest-ServerActionsTestOtherA-1653548153 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-067421d7-c8b7-4251-ac05-67bc21a2c9be', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '649569ff-bc03-443f-a835-672c6bbf1f30', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:15:35 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-7a6e571c-a961-427b-b924-507a2a5b0fe3 req-03cffea1-1afd-4557-a362-5b87da2a66f8 tempest-ServerActionsTestOtherA-1653548153 None] attachment_update completed successfully. Sep 09 18:15:40 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:15:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Flow 'volume_create_manager' (77313663-e81b-456a-88b9-eec2199ab13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:15:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b75879-eb75-4df5-a54e-9c710619bf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b75879-eb75-4df5-a54e-9c710619bf62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-882333660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe11d516-9f90-4f7d-a02f-092c38981bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf533d5788404081ba232964067f7e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:15:41Z,use_quota=True,user_id='568ba44d63c946b4bda86d5077620857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:15:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d07d146-a17f-444d-8231-47fd522f68da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d07d146-a17f-444d-8231-47fd522f68da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:15:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68746a5d-628b-409e-a3af-3fdf129c8ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68746a5d-628b-409e-a3af-3fdf129c8ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe11d516-9f90-4f7d-a02f-092c38981bf6', 'volume_name': 'volume-fe11d516-9f90-4f7d-a02f-092c38981bf6', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:15:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4418f9-08a3-4b17-9227-6720befb3f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4418f9-08a3-4b17-9227-6720befb3f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:15:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f65ec39f-4339-4246-9f81-d9d71b63d750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:40 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Volume fe11d516-9f90-4f7d-a02f-092c38981bf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe11d516-9f90-4f7d-a02f-092c38981bf6', 'volume_size': 1} Sep 09 18:15:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:15:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:15:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-882333660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe11d516-9f90-4f7d-a02f-092c38981bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf533d5788404081ba232964067f7e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:15:41Z,use_quota=True,user_id='568ba44d63c946b4bda86d5077620857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:15:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Creating volume fe11d516-9f90-4f7d-a02f-092c38981bf6 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:15:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:15:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:15:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:15:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:15:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:15:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:15:40 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:15:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fe11d516-9f90-4f7d-a02f-092c38981bf6 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:40 devstack sudo[93465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fe11d516-9f90-4f7d-a02f-092c38981bf6 1073741824 Sep 09 18:15:40 devstack sudo[93465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:41 devstack sudo[93465]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fe11d516-9f90-4f7d-a02f-092c38981bf6 1073741824" returned: 0 in 0.754s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fe11d516-9f90-4f7d-a02f-092c38981bf6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:41 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fe11d516-9f90-4f7d-a02f-092c38981bf6 Sep 09 18:15:41 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:41 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fe11d516-9f90-4f7d-a02f-092c38981bf6" returned: 0 in 0.295s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:41 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:15:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:15:41 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=65,cinder:UPDATE=57,cinder:INSERT=17,cinder:DELETE=5 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:15:41 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f65ec39f-4339-4246-9f81-d9d71b63d750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe11d516-9f90-4f7d-a02f-092c38981bf6', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:15:41 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb7a774-c8b0-4281-b330-bcefaeda0d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:41 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Volume volume-fe11d516-9f90-4f7d-a02f-092c38981bf6 (fe11d516-9f90-4f7d-a02f-092c38981bf6): created successfully Sep 09 18:15:41 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb7a774-c8b0-4281-b330-bcefaeda0d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:15:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Flow 'volume_create_manager' (77313663-e81b-456a-88b9-eec2199ab13b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:15:42 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-7ecbdf7b-5b77-4f45-ac2a-1786c4cce050 tempest-AttachVolumeNegativeTest-873560772 None] Created volume successfully. Sep 09 18:15:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:15:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:15:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:15:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:15:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:15:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:15:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:43 devstack sudo[93478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:15:43 devstack sudo[93478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:43 devstack sudo[93478]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.474s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:15:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:15:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 8 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:15:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:15:43 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=66,cinder:UPDATE=54,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:15:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-929ccbe1-4694-4099-96b6-e6d8cf703d73 req-65396b7f-8723-4f59-bc61-fdce293536fc tempest-AttachVolumeNegativeTest-873560772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:15:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-929ccbe1-4694-4099-96b6-e6d8cf703d73 req-65396b7f-8723-4f59-bc61-fdce293536fc tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:15:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-929ccbe1-4694-4099-96b6-e6d8cf703d73 req-65396b7f-8723-4f59-bc61-fdce293536fc tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:15:44 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-929ccbe1-4694-4099-96b6-e6d8cf703d73 req-65396b7f-8723-4f59-bc61-fdce293536fc tempest-AttachVolumeNegativeTest-873560772 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-fe11d516-9f90-4f7d-a02f-092c38981bf6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '661ca02e-b263-4e68-9107-cca3585ff98f', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:15:44 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-929ccbe1-4694-4099-96b6-e6d8cf703d73 req-65396b7f-8723-4f59-bc61-fdce293536fc tempest-AttachVolumeNegativeTest-873560772 None] attachment_update completed successfully. Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Flow 'volume_create_manager' (fe7106e8-f854-4a4d-b6d2-453079cd81c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aabd7b99-09ac-40fe-a52c-f576a8adf7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aabd7b99-09ac-40fe-a52c-f576a8adf7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1850012038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bef6d26-21b3-42bf-9854-eff1c8d83198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b75e6a5164d412eabcf0e436bbe087a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:15:45Z,use_quota=True,user_id='49d71af1dd8a413da03b23b55c5e0325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf5ca35-447a-42e2-aa6c-e71dfbb4ecb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cf5ca35-447a-42e2-aa6c-e71dfbb4ecb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a09651-0fbb-483f-8def-ecdc525d6b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5a09651-0fbb-483f-8def-ecdc525d6b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bef6d26-21b3-42bf-9854-eff1c8d83198', 'volume_name': 'volume-8bef6d26-21b3-42bf-9854-eff1c8d83198', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918387f3-61f8-4ddb-b2e9-d3c41d4e147b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918387f3-61f8-4ddb-b2e9-d3c41d4e147b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38aaff44-e24a-4771-af12-4586afd1bfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:45 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Volume 8bef6d26-21b3-42bf-9854-eff1c8d83198: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bef6d26-21b3-42bf-9854-eff1c8d83198', 'volume_size': 1} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1850012038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bef6d26-21b3-42bf-9854-eff1c8d83198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b75e6a5164d412eabcf0e436bbe087a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:15:45Z,use_quota=True,user_id='49d71af1dd8a413da03b23b55c5e0325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Creating volume 8bef6d26-21b3-42bf-9854-eff1c8d83198 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:15:45 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8bef6d26-21b3-42bf-9854-eff1c8d83198 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:45 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8bef6d26-21b3-42bf-9854-eff1c8d83198 1073741824 Sep 09 18:15:45 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:45 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8bef6d26-21b3-42bf-9854-eff1c8d83198 1073741824" returned: 0 in 0.428s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8bef6d26-21b3-42bf-9854-eff1c8d83198 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:45 devstack sudo[93514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8bef6d26-21b3-42bf-9854-eff1c8d83198 Sep 09 18:15:45 devstack sudo[93514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:45 devstack sudo[93514]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8bef6d26-21b3-42bf-9854-eff1c8d83198" returned: 0 in 0.284s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38aaff44-e24a-4771-af12-4586afd1bfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bef6d26-21b3-42bf-9854-eff1c8d83198', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (911c2994-753b-4513-87cf-a1c443966ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:45 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Volume volume-8bef6d26-21b3-42bf-9854-eff1c8d83198 (8bef6d26-21b3-42bf-9854-eff1c8d83198): created successfully Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (911c2994-753b-4513-87cf-a1c443966ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:15:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Flow 'volume_create_manager' (fe7106e8-f854-4a4d-b6d2-453079cd81c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:15:46 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-3d943639-c4b3-445f-a846-b84635bbb57c tempest-VolumeQuotasNegativeTestJSON-37552013 None] Created volume successfully. Sep 09 18:15:47 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-7fbcf0c8-1267-410e-a6e5-b88925b8635b req-36f0edc1-5c20-434f-9be7-a0b19fb4ce01 tempest-AttachVolumeNegativeTest-873560772 None] Terminate volume connection completed successfully. Sep 09 18:15:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-7fbcf0c8-1267-410e-a6e5-b88925b8635b req-36f0edc1-5c20-434f-9be7-a0b19fb4ce01 tempest-AttachVolumeNegativeTest-873560772 None] Deleting attachment 661ca02e-b263-4e68-9107-cca3585ff98f. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:15:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4bd86f4d-1641-4963-986c-38b201af7d56 tempest-VolumeQuotasNegativeTestJSON-37552013 None] Acquiring lock "cinder-8bef6d26-21b3-42bf-9854-eff1c8d83198-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:15:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4bd86f4d-1641-4963-986c-38b201af7d56 tempest-VolumeQuotasNegativeTestJSON-37552013 None] Lock "cinder-8bef6d26-21b3-42bf-9854-eff1c8d83198-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:15:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4bd86f4d-1641-4963-986c-38b201af7d56 tempest-VolumeQuotasNegativeTestJSON-37552013 None] Acquiring lock "cinder-quobyte-8bef6d26-21b3-42bf-9854-eff1c8d83198" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:15:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4bd86f4d-1641-4963-986c-38b201af7d56 tempest-VolumeQuotasNegativeTestJSON-37552013 None] Lock "cinder-quobyte-8bef6d26-21b3-42bf-9854-eff1c8d83198" acquired by "delete_volume" :: waited 0.043s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:15:49 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed28c8e2-3d99-467a-86cf-2bda25c704f9]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:15:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4bd86f4d-1641-4963-986c-38b201af7d56 tempest-VolumeQuotasNegativeTestJSON-37552013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8bef6d26-21b3-42bf-9854-eff1c8d83198 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:49 devstack sudo[93555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8bef6d26-21b3-42bf-9854-eff1c8d83198 Sep 09 18:15:49 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-0318cb16-1bd8-4010-8e2d-6ab9891ff3b7 req-f5d7c874-44a2-4c81-8da4-b04ccc5f0e05 tempest-AttachVolumeShelveTestJSON-1650110475 None] No connector for attachment d151f2f0-dbc0-4f47-8495-fd1238e5ab32; skipping storage backend terminate_connection call. {{(pid=87639) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 09 18:15:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-0318cb16-1bd8-4010-8e2d-6ab9891ff3b7 req-f5d7c874-44a2-4c81-8da4-b04ccc5f0e05 tempest-AttachVolumeShelveTestJSON-1650110475 None] Deleting attachment d151f2f0-dbc0-4f47-8495-fd1238e5ab32. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:15:49 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4bd86f4d-1641-4963-986c-38b201af7d56 tempest-VolumeQuotasNegativeTestJSON-37552013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8bef6d26-21b3-42bf-9854-eff1c8d83198" returned: 0 in 0.529s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4bd86f4d-1641-4963-986c-38b201af7d56 tempest-VolumeQuotasNegativeTestJSON-37552013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8bef6d26-21b3-42bf-9854-eff1c8d83198 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:49 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8bef6d26-21b3-42bf-9854-eff1c8d83198 Sep 09 18:15:49 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:49 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4bd86f4d-1641-4963-986c-38b201af7d56 tempest-VolumeQuotasNegativeTestJSON-37552013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8bef6d26-21b3-42bf-9854-eff1c8d83198" returned: 0 in 0.411s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4bd86f4d-1641-4963-986c-38b201af7d56 tempest-VolumeQuotasNegativeTestJSON-37552013 None] Lock "cinder-quobyte-8bef6d26-21b3-42bf-9854-eff1c8d83198" released by "delete_volume" :: held 1.013s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:15:50 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-4bd86f4d-1641-4963-986c-38b201af7d56 tempest-VolumeQuotasNegativeTestJSON-37552013 None] Created reservations ['e4fa0285-8d59-4893-8ec3-464a17ad3669', '659451e4-5ea6-4b60-a6e1-ba03923f996a', '839c0017-8995-4ca5-aaa4-b4cf92f989dd', '1ec0b8c4-ef10-4a8e-9ec0-03d35286d9d4'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:15:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4bd86f4d-1641-4963-986c-38b201af7d56 tempest-VolumeQuotasNegativeTestJSON-37552013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:15:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4bd86f4d-1641-4963-986c-38b201af7d56 tempest-VolumeQuotasNegativeTestJSON-37552013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:15:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4bd86f4d-1641-4963-986c-38b201af7d56 tempest-VolumeQuotasNegativeTestJSON-37552013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:15:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4bd86f4d-1641-4963-986c-38b201af7d56 tempest-VolumeQuotasNegativeTestJSON-37552013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:15:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4bd86f4d-1641-4963-986c-38b201af7d56 tempest-VolumeQuotasNegativeTestJSON-37552013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:15:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4bd86f4d-1641-4963-986c-38b201af7d56 tempest-VolumeQuotasNegativeTestJSON-37552013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:50 devstack sudo[93570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:15:50 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:15:50 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root Sep 09 18:15:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4bd86f4d-1641-4963-986c-38b201af7d56 tempest-VolumeQuotasNegativeTestJSON-37552013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.340s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:15:50 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-4bd86f4d-1641-4963-986c-38b201af7d56 tempest-VolumeQuotasNegativeTestJSON-37552013 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:15:50 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-4bd86f4d-1641-4963-986c-38b201af7d56 tempest-VolumeQuotasNegativeTestJSON-37552013 None] Deleted volume successfully. Sep 09 18:15:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4bd86f4d-1641-4963-986c-38b201af7d56 tempest-VolumeQuotasNegativeTestJSON-37552013 None] Lock "cinder-8bef6d26-21b3-42bf-9854-eff1c8d83198-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:15:59 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:15:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Flow 'volume_create_manager' (2139a756-8721-433f-9e91-922b9c546c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:15:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3564b8ee-7cdf-4d88-b5fb-183d9fa0e6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3564b8ee-7cdf-4d88-b5fb-183d9fa0e6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1955353010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90aa6da9-590e-4809-aa13-13e44939fd6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdcb62907c04c8ea87bf4cba51404c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:15:59Z,use_quota=True,user_id='3cd618d1b5a842efbb46aad22e605141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22a1fa4d-d377-48f2-aee6-337025edc85c),volume_type_id=22a1fa4d-d377-48f2-aee6-337025edc85c)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:15:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41862cd-d5c3-4649-a4c5-0837e7fe0acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41862cd-d5c3-4649-a4c5-0837e7fe0acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:15:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (058bd8c6-047c-4762-a231-0d375122ded8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (058bd8c6-047c-4762-a231-0d375122ded8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90aa6da9-590e-4809-aa13-13e44939fd6c', 'volume_name': 'volume-90aa6da9-590e-4809-aa13-13e44939fd6c', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:15:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd00ca63-d06c-4d6c-aba6-c1ebeb333608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd00ca63-d06c-4d6c-aba6-c1ebeb333608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:15:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5687b286-4669-4d66-850f-370dca9b423d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:15:59 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Volume 90aa6da9-590e-4809-aa13-13e44939fd6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90aa6da9-590e-4809-aa13-13e44939fd6c', 'volume_size': 1} Sep 09 18:15:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:15:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:15:59 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1955353010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90aa6da9-590e-4809-aa13-13e44939fd6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fdcb62907c04c8ea87bf4cba51404c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:15:59Z,use_quota=True,user_id='3cd618d1b5a842efbb46aad22e605141',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22a1fa4d-d377-48f2-aee6-337025edc85c),volume_type_id=22a1fa4d-d377-48f2-aee6-337025edc85c)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:15:59 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Creating volume 90aa6da9-590e-4809-aa13-13e44939fd6c {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:15:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:15:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:15:59 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:15:59 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:15:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:15:59 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:15:59 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:15:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-90aa6da9-590e-4809-aa13-13e44939fd6c 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:15:59 devstack sudo[93715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-90aa6da9-590e-4809-aa13-13e44939fd6c 1073741824 Sep 09 18:15:59 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:00 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-90aa6da9-590e-4809-aa13-13e44939fd6c 1073741824" returned: 0 in 0.872s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-90aa6da9-590e-4809-aa13-13e44939fd6c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:00 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-90aa6da9-590e-4809-aa13-13e44939fd6c Sep 09 18:16:00 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:00 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-90aa6da9-590e-4809-aa13-13e44939fd6c" returned: 0 in 0.478s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:00 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:16:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:16:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5687b286-4669-4d66-850f-370dca9b423d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90aa6da9-590e-4809-aa13-13e44939fd6c', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:16:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4ba10c-59e6-439a-9a0a-2949166a19aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:16:00 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Volume volume-90aa6da9-590e-4809-aa13-13e44939fd6c (90aa6da9-590e-4809-aa13-13e44939fd6c): created successfully Sep 09 18:16:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c4ba10c-59e6-439a-9a0a-2949166a19aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:16:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Flow 'volume_create_manager' (2139a756-8721-433f-9e91-922b9c546c03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:16:01 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-f04790f4-bc7b-427b-b6dd-43c93de9f127 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Created volume successfully. Sep 09 18:16:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-89988869-e710-49ef-a1e2-e963576fdd4a tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:16:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-89988869-e710-49ef-a1e2-e963576fdd4a tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:16:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-89988869-e710-49ef-a1e2-e963576fdd4a tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:16:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-89988869-e710-49ef-a1e2-e963576fdd4a tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:16:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-89988869-e710-49ef-a1e2-e963576fdd4a tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:16:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-89988869-e710-49ef-a1e2-e963576fdd4a tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:02 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:16:02 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:03 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-89988869-e710-49ef-a1e2-e963576fdd4a tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.458s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:03 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-89988869-e710-49ef-a1e2-e963576fdd4a tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:16:03 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-89988869-e710-49ef-a1e2-e963576fdd4a tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Retype volume completed successfully. Sep 09 18:16:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-995d1088-a591-464d-a36a-10be616b9f12 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Acquiring lock "cinder-90aa6da9-590e-4809-aa13-13e44939fd6c-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:16:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-995d1088-a591-464d-a36a-10be616b9f12 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Lock "cinder-90aa6da9-590e-4809-aa13-13e44939fd6c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:16:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-995d1088-a591-464d-a36a-10be616b9f12 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Acquiring lock "cinder-quobyte-90aa6da9-590e-4809-aa13-13e44939fd6c" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:16:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-995d1088-a591-464d-a36a-10be616b9f12 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Lock "cinder-quobyte-90aa6da9-590e-4809-aa13-13e44939fd6c" acquired by "delete_volume" :: waited 0.022s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:16:04 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeef8c86-be67-4096-b090-71bf21496fd1]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:16:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-995d1088-a591-464d-a36a-10be616b9f12 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-90aa6da9-590e-4809-aa13-13e44939fd6c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:04 devstack sudo[93820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-90aa6da9-590e-4809-aa13-13e44939fd6c Sep 09 18:16:04 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:04 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-2451ac19-1904-49eb-b120-62f3e28c7fd7 req-ac550f75-ba04-4792-95af-b9c5a842e022 tempest-ServerActionsTestOtherA-1653548153 None] Terminate volume connection completed successfully. Sep 09 18:16:04 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-2451ac19-1904-49eb-b120-62f3e28c7fd7 req-ac550f75-ba04-4792-95af-b9c5a842e022 tempest-ServerActionsTestOtherA-1653548153 None] Deleting attachment 649569ff-bc03-443f-a835-672c6bbf1f30. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:16:05 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-995d1088-a591-464d-a36a-10be616b9f12 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-90aa6da9-590e-4809-aa13-13e44939fd6c" returned: 0 in 0.653s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-995d1088-a591-464d-a36a-10be616b9f12 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-90aa6da9-590e-4809-aa13-13e44939fd6c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:05 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-90aa6da9-590e-4809-aa13-13e44939fd6c Sep 09 18:16:05 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:05 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-995d1088-a591-464d-a36a-10be616b9f12 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-90aa6da9-590e-4809-aa13-13e44939fd6c" returned: 0 in 0.342s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-995d1088-a591-464d-a36a-10be616b9f12 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Lock "cinder-quobyte-90aa6da9-590e-4809-aa13-13e44939fd6c" released by "delete_volume" :: held 1.071s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:16:05 devstack cinder-volume[87639]: WARNING cinder.quota [None req-995d1088-a591-464d-a36a-10be616b9f12 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:16:05 devstack cinder-volume[87639]: WARNING cinder.quota [None req-995d1088-a591-464d-a36a-10be616b9f12 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:16:05 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-995d1088-a591-464d-a36a-10be616b9f12 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Created reservations ['9f10af52-5d86-4d82-bdf9-90e8bd20b439', '1c4a3bf2-af4f-4909-9a57-fc785ceed80f', '54387634-f7cb-4b4f-9928-781dfcdbcc70', '5aad2329-238a-4ec9-b830-487b7d7e561e'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:16:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-995d1088-a591-464d-a36a-10be616b9f12 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:16:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-995d1088-a591-464d-a36a-10be616b9f12 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:16:05 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-995d1088-a591-464d-a36a-10be616b9f12 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:16:05 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-995d1088-a591-464d-a36a-10be616b9f12 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:16:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-995d1088-a591-464d-a36a-10be616b9f12 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:16:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-995d1088-a591-464d-a36a-10be616b9f12 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:05 devstack sudo[93834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:16:05 devstack sudo[93834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:06 devstack sudo[93834]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-995d1088-a591-464d-a36a-10be616b9f12 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.816s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:06 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-995d1088-a591-464d-a36a-10be616b9f12 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:16:06 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-995d1088-a591-464d-a36a-10be616b9f12 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Deleted volume successfully. Sep 09 18:16:06 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-995d1088-a591-464d-a36a-10be616b9f12 tempest-VolumeRetypeWithoutMigrationTest-1060397106 None] Lock "cinder-90aa6da9-590e-4809-aa13-13e44939fd6c-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:16:17 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:16:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Flow 'volume_create_manager' (6aca445b-0ec2-4c3c-a3a6-0c51263630d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:16:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98570d39-b0d8-4135-b838-2ebe6d60c188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:16:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98570d39-b0d8-4135-b838-2ebe6d60c188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-688317022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e710e2d-2163-41fe-9942-afded99d053c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b81bbb67f134a889d208be6df698c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:16:17Z,use_quota=True,user_id='f6df018fdd6c4611844893768c3b44f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:16:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c37d387-1d98-4bcb-9c8a-ff5f230f2b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:16:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c37d387-1d98-4bcb-9c8a-ff5f230f2b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:16:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e60ce3-7c2d-4e1f-9f78-7079527968f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:16:17 devstack cinder-volume[87639]: DEBUG cinder.image.glance [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Creating Keystone auth plugin from conf {{(pid=87639) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 18:16:18 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e60ce3-7c2d-4e1f-9f78-7079527968f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1e710e2d-2163-41fe-9942-afded99d053c', 'volume_name': 'volume-1e710e2d-2163-41fe-9942-afded99d053c', 'volume_size': 1, 'image_id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7ff1e5c089804fe694a8f7d1bf0a7374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'created_at': datetime.datetime(2026, 9, 9, 16, 5, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 5, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:16:18 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3d08f8-753d-4dfc-80ec-d41d0f149b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:16:18 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a3d08f8-753d-4dfc-80ec-d41d0f149b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:16:18 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114e6e40-322d-425a-a8dc-09d7426ba33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:16:18 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Volume 1e710e2d-2163-41fe-9942-afded99d053c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1e710e2d-2163-41fe-9942-afded99d053c', 'volume_size': 1, 'image_id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7ff1e5c089804fe694a8f7d1bf0a7374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'created_at': datetime.datetime(2026, 9, 9, 16, 5, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 5, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 18:16:18 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Trying to clone 1e710e2d-2163-41fe-9942-afded99d053c from image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}]). {{(pid=87639) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 18:16:18 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_mh0yeldxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 18:16:18 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Image download 20.69 MB at 20.69 MB/s Sep 09 18:16:18 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4222013e-bbb7-4a2c-bf7d-95b69da32211]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:16:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_mh0yeldxdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:18 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_mh0yeldxdevstack@QuobyteHD Sep 09 18:16:18 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:18 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:16:18 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Flow 'volume_create_manager' (94989c4a-fe05-4d81-9f9c-ceb5ec0b0216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:16:18 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a569ec6-2213-4dd1-ae49-964c101e26c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:16:18 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a569ec6-2213-4dd1-ae49-964c101e26c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-444375579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5888a9f-a87d-4e36-bf72-6c2242c657cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab394194da14f4d92aa03c02969e93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:16:19Z,use_quota=True,user_id='39502812e9db43a699627e38b52f5790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:16:18 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae8fcde-b468-4595-8615-d64ff018b273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:16:18 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae8fcde-b468-4595-8615-d64ff018b273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598527a5-385b-4e33-99d0-be79cb570fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598527a5-385b-4e33-99d0-be79cb570fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5888a9f-a87d-4e36-bf72-6c2242c657cb', 'volume_name': 'volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6780b6d1-aa03-40ad-a9bd-8554bb02f8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6780b6d1-aa03-40ad-a9bd-8554bb02f8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea2d68a-c60d-458d-a058-f49b86551049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:16:19 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Volume b5888a9f-a87d-4e36-bf72-6c2242c657cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb', 'volume_size': 1} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-444375579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5888a9f-a87d-4e36-bf72-6c2242c657cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab394194da14f4d92aa03c02969e93b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:16:19Z,use_quota=True,user_id='39502812e9db43a699627e38b52f5790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Creating volume b5888a9f-a87d-4e36-bf72-6c2242c657cb {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:16:19 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:19 devstack sudo[93973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb 1073741824 Sep 09 18:16:19 devstack sudo[93973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:19 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_mh0yeldxdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Temporary image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 is fetched for user f6df018fdd6c4611844893768c3b44f1. {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb23df9-72a8-4c86-a252-b84fbc51e641]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_mh0yeldxdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:19 devstack sudo[93978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_mh0yeldxdevstack@QuobyteHD Sep 09 18:16:19 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:19 devstack sudo[93973]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb 1073741824" returned: 0 in 0.494s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:19 devstack sudo[93990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb Sep 09 18:16:19 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:19 devstack sudo[93978]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_mh0yeldxdevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:16:19 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb" returned: 0 in 0.286s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.196s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-688317022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e710e2d-2163-41fe-9942-afded99d053c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b81bbb67f134a889d208be6df698c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:16:17Z,use_quota=True,user_id='f6df018fdd6c4611844893768c3b44f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Creating volume 1e710e2d-2163-41fe-9942-afded99d053c {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:16:19 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e710e2d-2163-41fe-9942-afded99d053c 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fea2d68a-c60d-458d-a058-f49b86551049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:16:19 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e710e2d-2163-41fe-9942-afded99d053c 1073741824 Sep 09 18:16:19 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12886c3e-2bae-4c24-8888-c5f53c438ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:16:19 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Volume volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb (b5888a9f-a87d-4e36-bf72-6c2242c657cb): created successfully Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12886c3e-2bae-4c24-8888-c5f53c438ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:16:19 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Flow 'volume_create_manager' (94989c4a-fe05-4d81-9f9c-ceb5ec0b0216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:16:19 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-a183d5ca-c7c1-47c5-93dd-14745b4399fa tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Created volume successfully. Sep 09 18:16:20 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e710e2d-2163-41fe-9942-afded99d053c 1073741824" returned: 0 in 0.408s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e710e2d-2163-41fe-9942-afded99d053c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:20 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e710e2d-2163-41fe-9942-afded99d053c Sep 09 18:16:20 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:20 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e710e2d-2163-41fe-9942-afded99d053c" returned: 0 in 0.287s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:16:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:16:20 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Attempting download of 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 ((None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}])) to volume 1e710e2d-2163-41fe-9942-afded99d053c. {{(pid=87639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 18:16:20 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad17db9-3c8e-4750-b934-71c54d1b4e63]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:16:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_8xonkrlg {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:20 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_8xonkrlg Sep 09 18:16:20 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:21 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_8xonkrlg" returned: 0 in 0.353s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_8xonkrlg {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:21 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_8xonkrlg Sep 09 18:16:21 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bf886813-83db-4a1a-8ec2-f27e02d93629 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:16:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bf886813-83db-4a1a-8ec2-f27e02d93629 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:16:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-bf886813-83db-4a1a-8ec2-f27e02d93629 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Creating offline snapshot 7a34fd03-6401-4253-a3a7-429bda568a21 of volume b5888a9f-a87d-4e36-bf72-6c2242c657cb {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:16:21 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fa3a81-c1ca-4969-bcee-93ae87518849]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:16:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bf886813-83db-4a1a-8ec2-f27e02d93629 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:21 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb Sep 09 18:16:21 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:21 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_8xonkrlg" returned: 1 in 0.392s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_8xonkrlg' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:16:21 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[806fa590-4364-498c-baa3-fb655adc79e4]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:16:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_mh0yeldxdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:21 devstack sudo[94014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_mh0yeldxdevstack@QuobyteHD Sep 09 18:16:21 devstack sudo[94014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:21 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bf886813-83db-4a1a-8ec2-f27e02d93629 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb" returned: 0 in 0.378s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bf886813-83db-4a1a-8ec2-f27e02d93629 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.7a34fd03-6401-4253-a3a7-429bda568a21 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:21 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.7a34fd03-6401-4253-a3a7-429bda568a21 1G Sep 09 18:16:21 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:21 devstack sudo[94014]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_mh0yeldxdevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:21 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 was qcow2, converting to qcow2 {{(pid=87639) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 18:16:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_mh0yeldxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e710e2d-2163-41fe-9942-afded99d053c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:21 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_mh0yeldxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e710e2d-2163-41fe-9942-afded99d053c Sep 09 18:16:21 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:22 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bf886813-83db-4a1a-8ec2-f27e02d93629 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.7a34fd03-6401-4253-a3a7-429bda568a21 1G" returned: 0 in 0.426s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bf886813-83db-4a1a-8ec2-f27e02d93629 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.7a34fd03-6401-4253-a3a7-429bda568a21 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:22 devstack sudo[94033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.7a34fd03-6401-4253-a3a7-429bda568a21 Sep 09 18:16:22 devstack sudo[94033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:22 devstack sudo[94033]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bf886813-83db-4a1a-8ec2-f27e02d93629 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.7a34fd03-6401-4253-a3a7-429bda568a21" returned: 0 in 0.338s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:22 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-bf886813-83db-4a1a-8ec2-f27e02d93629 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.7a34fd03-6401-4253-a3a7-429bda568a21 is being set with open permissions: ugo+rw Sep 09 18:16:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bf886813-83db-4a1a-8ec2-f27e02d93629 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.7a34fd03-6401-4253-a3a7-429bda568a21 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:22 devstack sudo[94046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.7a34fd03-6401-4253-a3a7-429bda568a21 Sep 09 18:16:22 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:22 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bf886813-83db-4a1a-8ec2-f27e02d93629 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.7a34fd03-6401-4253-a3a7-429bda568a21" returned: 0 in 0.363s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bf886813-83db-4a1a-8ec2-f27e02d93629 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:22 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.info Sep 09 18:16:22 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:23 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bf886813-83db-4a1a-8ec2-f27e02d93629 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.info" returned: 0 in 0.364s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:23 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-bf886813-83db-4a1a-8ec2-f27e02d93629 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.info is being set with open permissions: ugo+rw Sep 09 18:16:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bf886813-83db-4a1a-8ec2-f27e02d93629 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:23 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.info Sep 09 18:16:23 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:23 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bf886813-83db-4a1a-8ec2-f27e02d93629 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.info" returned: 0 in 0.293s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bf886813-83db-4a1a-8ec2-f27e02d93629 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.264s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:16:23 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-bf886813-83db-4a1a-8ec2-f27e02d93629 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Create snapshot completed successfully Sep 09 18:16:23 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_mh0yeldxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e710e2d-2163-41fe-9942-afded99d053c" returned: 0 in 1.904s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:23 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_mh0yeldxdevstack@QuobyteHD, size 112.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e710e2d-2163-41fe-9942-afded99d053c {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:16:23 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Converted 112.00 MB image at 58.78 MB/s Sep 09 18:16:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e710e2d-2163-41fe-9942-afded99d053c 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:23 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e710e2d-2163-41fe-9942-afded99d053c 1G Sep 09 18:16:23 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:24 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e710e2d-2163-41fe-9942-afded99d053c 1G" returned: 0 in 0.340s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:24 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Downloaded image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 ((None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}])) to volume 1e710e2d-2163-41fe-9942-afded99d053c successfully. {{(pid=87639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 18:16:24 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Temporary image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 for user f6df018fdd6c4611844893768c3b44f1 is deleted. {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 18:16:24 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Marking volume 1e710e2d-2163-41fe-9942-afded99d053c as bootable. {{(pid=87639) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 18:16:24 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Copying metadata from image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 to 1e710e2d-2163-41fe-9942-afded99d053c. {{(pid=87639) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 18:16:24 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Creating volume glance metadata for volume 1e710e2d-2163-41fe-9942-afded99d053c backed by image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87639) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 18:16:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114e6e40-322d-425a-a8dc-09d7426ba33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e710e2d-2163-41fe-9942-afded99d053c', 'volume_size': 1, 'image_id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7ff1e5c089804fe694a8f7d1bf0a7374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'created_at': datetime.datetime(2026, 9, 9, 16, 5, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 5, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:16:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (354d5e23-151b-48ab-bd3a-7c6a1518e47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:16:24 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Volume volume-1e710e2d-2163-41fe-9942-afded99d053c (1e710e2d-2163-41fe-9942-afded99d053c): created successfully Sep 09 18:16:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (354d5e23-151b-48ab-bd3a-7c6a1518e47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:16:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Flow 'volume_create_manager' (6aca445b-0ec2-4c3c-a3a6-0c51263630d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:16:24 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-2ca9106d-b9e4-421d-ae4e-cc3e162fa393 tempest-ServerActionsTestOtherA-1653548153 None] Created volume successfully. Sep 09 18:16:24 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3985c7ec-568a-422a-b0f3-45c945b19a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Acquiring lock "cinder-7a34fd03-6401-4253-a3a7-429bda568a21-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:16:24 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3985c7ec-568a-422a-b0f3-45c945b19a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Lock "cinder-7a34fd03-6401-4253-a3a7-429bda568a21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:16:24 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3985c7ec-568a-422a-b0f3-45c945b19a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Acquiring lock "cinder-quobyte-b5888a9f-a87d-4e36-bf72-6c2242c657cb" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:16:24 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3985c7ec-568a-422a-b0f3-45c945b19a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Lock "cinder-quobyte-b5888a9f-a87d-4e36-bf72-6c2242c657cb" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:16:24 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3985c7ec-568a-422a-b0f3-45c945b19a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Acquiring lock "cinder-quobyte-7a34fd03-6401-4253-a3a7-429bda568a21" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:16:24 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3985c7ec-568a-422a-b0f3-45c945b19a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Lock "cinder-quobyte-7a34fd03-6401-4253-a3a7-429bda568a21" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:16:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-3985c7ec-568a-422a-b0f3-45c945b19a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Deleting offline snapshot 7a34fd03-6401-4253-a3a7-429bda568a21 of volume b5888a9f-a87d-4e36-bf72-6c2242c657cb {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:16:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-3985c7ec-568a-422a-b0f3-45c945b19a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] snapshot_file for this snap is: volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.7a34fd03-6401-4253-a3a7-429bda568a21 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:16:24 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[799c8c68-92ff-446a-ab7f-641b3c830c74]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:16:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3985c7ec-568a-422a-b0f3-45c945b19a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.7a34fd03-6401-4253-a3a7-429bda568a21 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:25 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.7a34fd03-6401-4253-a3a7-429bda568a21 Sep 09 18:16:25 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:25 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3985c7ec-568a-422a-b0f3-45c945b19a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.7a34fd03-6401-4253-a3a7-429bda568a21" returned: 0 in 0.390s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:25 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-3985c7ec-568a-422a-b0f3-45c945b19a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:16:25 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f050801-3469-4821-8b75-374c7c4830e9]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:16:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3985c7ec-568a-422a-b0f3-45c945b19a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:25 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb Sep 09 18:16:25 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:25 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3985c7ec-568a-422a-b0f3-45c945b19a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb" returned: 0 in 0.372s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3985c7ec-568a-422a-b0f3-45c945b19a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.7a34fd03-6401-4253-a3a7-429bda568a21 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:25 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.7a34fd03-6401-4253-a3a7-429bda568a21 Sep 09 18:16:25 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:26 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3985c7ec-568a-422a-b0f3-45c945b19a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.7a34fd03-6401-4253-a3a7-429bda568a21" returned: 0 in 0.434s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3985c7ec-568a-422a-b0f3-45c945b19a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.7a34fd03-6401-4253-a3a7-429bda568a21 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:26 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.7a34fd03-6401-4253-a3a7-429bda568a21 Sep 09 18:16:26 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:26 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3985c7ec-568a-422a-b0f3-45c945b19a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb.7a34fd03-6401-4253-a3a7-429bda568a21" returned: 0 in 0.293s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:26 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3985c7ec-568a-422a-b0f3-45c945b19a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Lock "cinder-quobyte-7a34fd03-6401-4253-a3a7-429bda568a21" released by "_delete_snapshot" :: held 1.607s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:16:26 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3985c7ec-568a-422a-b0f3-45c945b19a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Lock "cinder-quobyte-b5888a9f-a87d-4e36-bf72-6c2242c657cb" released by "delete_snapshot" :: held 1.636s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:16:26 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-3985c7ec-568a-422a-b0f3-45c945b19a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Created reservations ['b7d2a637-3943-4812-babe-c845968be7ec', 'ca94e4df-056f-4616-ad88-c943663dc028', '575e1e35-05c4-4476-9123-6f8e1dc9985e', '2eb835f4-8542-40f3-a5d2-2f01e849ceb0'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:16:26 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-3985c7ec-568a-422a-b0f3-45c945b19a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Delete snapshot completed successfully. Sep 09 18:16:26 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3985c7ec-568a-422a-b0f3-45c945b19a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Lock "cinder-7a34fd03-6401-4253-a3a7-429bda568a21-delete_snapshot" released by "delete_snapshot" :: held 1.825s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:16:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-964838a1-4f0d-4ba4-9c76-9005d221c995 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Acquiring lock "cinder-b5888a9f-a87d-4e36-bf72-6c2242c657cb-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:16:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-964838a1-4f0d-4ba4-9c76-9005d221c995 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Lock "cinder-b5888a9f-a87d-4e36-bf72-6c2242c657cb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:16:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-964838a1-4f0d-4ba4-9c76-9005d221c995 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Acquiring lock "cinder-quobyte-b5888a9f-a87d-4e36-bf72-6c2242c657cb" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:16:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-964838a1-4f0d-4ba4-9c76-9005d221c995 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Lock "cinder-quobyte-b5888a9f-a87d-4e36-bf72-6c2242c657cb" acquired by "delete_volume" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:16:27 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e523a490-43d2-4fbe-9a2e-9ee76f5be885]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:16:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-964838a1-4f0d-4ba4-9c76-9005d221c995 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:27 devstack sudo[94129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb Sep 09 18:16:27 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-c3fa55d0-200c-40be-9185-0816af0761de req-b64ac543-c451-470b-bab9-28e3c247e092 tempest-ServerActionsTestOtherA-1653548153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:16:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-c3fa55d0-200c-40be-9185-0816af0761de req-b64ac543-c451-470b-bab9-28e3c247e092 tempest-ServerActionsTestOtherA-1653548153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:16:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-c3fa55d0-200c-40be-9185-0816af0761de req-b64ac543-c451-470b-bab9-28e3c247e092 tempest-ServerActionsTestOtherA-1653548153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:16:27 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-c3fa55d0-200c-40be-9185-0816af0761de req-b64ac543-c451-470b-bab9-28e3c247e092 tempest-ServerActionsTestOtherA-1653548153 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-1e710e2d-2163-41fe-9942-afded99d053c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '33fdca42-440b-4b8b-a6b6-203c2385af73', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:16:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-964838a1-4f0d-4ba4-9c76-9005d221c995 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb" returned: 0 in 0.517s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-964838a1-4f0d-4ba4-9c76-9005d221c995 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:27 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb Sep 09 18:16:27 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:28 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-c3fa55d0-200c-40be-9185-0816af0761de req-b64ac543-c451-470b-bab9-28e3c247e092 tempest-ServerActionsTestOtherA-1653548153 None] attachment_update completed successfully. Sep 09 18:16:28 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-964838a1-4f0d-4ba4-9c76-9005d221c995 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5888a9f-a87d-4e36-bf72-6c2242c657cb" returned: 0 in 0.367s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:28 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-964838a1-4f0d-4ba4-9c76-9005d221c995 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Lock "cinder-quobyte-b5888a9f-a87d-4e36-bf72-6c2242c657cb" released by "delete_volume" :: held 0.988s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:16:28 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-964838a1-4f0d-4ba4-9c76-9005d221c995 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Created reservations ['71323858-c8ad-4f99-891a-c33bcf3300ea', '3f656cb2-30c3-4039-b32a-360f3423e17b', 'ac251211-e61c-474a-b831-9404a48d3d53', '7782df66-0bc7-4fe3-9c91-035e3d711149'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:16:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-964838a1-4f0d-4ba4-9c76-9005d221c995 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:16:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-964838a1-4f0d-4ba4-9c76-9005d221c995 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:16:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-964838a1-4f0d-4ba4-9c76-9005d221c995 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:16:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-964838a1-4f0d-4ba4-9c76-9005d221c995 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:16:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-964838a1-4f0d-4ba4-9c76-9005d221c995 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:16:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-964838a1-4f0d-4ba4-9c76-9005d221c995 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:28 devstack sudo[94148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:16:28 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:28 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-964838a1-4f0d-4ba4-9c76-9005d221c995 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.275s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:28 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-964838a1-4f0d-4ba4-9c76-9005d221c995 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:16:28 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-964838a1-4f0d-4ba4-9c76-9005d221c995 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Deleted volume successfully. Sep 09 18:16:28 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-964838a1-4f0d-4ba4-9c76-9005d221c995 tempest-VolumeSnapshotQuotasNegativeTestJSON-818622806 None] Lock "cinder-b5888a9f-a87d-4e36-bf72-6c2242c657cb-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:16:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-522cf36b-3002-4a34-ae02-0f03f38dda0f tempest-AttachVolumeShelveTestJSON-1650110475 None] Acquiring lock "cinder-13c15160-8414-4072-9bb6-f935e7599a89-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:16:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-522cf36b-3002-4a34-ae02-0f03f38dda0f tempest-AttachVolumeShelveTestJSON-1650110475 None] Lock "cinder-13c15160-8414-4072-9bb6-f935e7599a89-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:16:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-522cf36b-3002-4a34-ae02-0f03f38dda0f tempest-AttachVolumeShelveTestJSON-1650110475 None] Acquiring lock "cinder-quobyte-13c15160-8414-4072-9bb6-f935e7599a89" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:16:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-522cf36b-3002-4a34-ae02-0f03f38dda0f tempest-AttachVolumeShelveTestJSON-1650110475 None] Lock "cinder-quobyte-13c15160-8414-4072-9bb6-f935e7599a89" acquired by "delete_volume" :: waited 0.032s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:16:33 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffda5303-e4c3-432f-848e-6ffa3a9500f5]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:16:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-522cf36b-3002-4a34-ae02-0f03f38dda0f tempest-AttachVolumeShelveTestJSON-1650110475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-13c15160-8414-4072-9bb6-f935e7599a89 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:33 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-13c15160-8414-4072-9bb6-f935e7599a89 Sep 09 18:16:33 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:33 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-522cf36b-3002-4a34-ae02-0f03f38dda0f tempest-AttachVolumeShelveTestJSON-1650110475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-13c15160-8414-4072-9bb6-f935e7599a89" returned: 0 in 0.754s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-522cf36b-3002-4a34-ae02-0f03f38dda0f tempest-AttachVolumeShelveTestJSON-1650110475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-13c15160-8414-4072-9bb6-f935e7599a89 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:33 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-13c15160-8414-4072-9bb6-f935e7599a89 Sep 09 18:16:33 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-522cf36b-3002-4a34-ae02-0f03f38dda0f tempest-AttachVolumeShelveTestJSON-1650110475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-13c15160-8414-4072-9bb6-f935e7599a89" returned: 0 in 0.399s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:34 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-522cf36b-3002-4a34-ae02-0f03f38dda0f tempest-AttachVolumeShelveTestJSON-1650110475 None] Lock "cinder-quobyte-13c15160-8414-4072-9bb6-f935e7599a89" released by "delete_volume" :: held 1.258s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:16:34 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-522cf36b-3002-4a34-ae02-0f03f38dda0f tempest-AttachVolumeShelveTestJSON-1650110475 None] Created reservations ['184959f5-0adf-4225-a4de-30028f0e1238', '9e3d6a32-1a4c-46cb-81ac-36ed206c836f', 'b64be6a7-897f-4619-a2a5-65509e0801cb', '519e1f5a-92aa-48af-b0d6-bc135a5fd2c9'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:16:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-522cf36b-3002-4a34-ae02-0f03f38dda0f tempest-AttachVolumeShelveTestJSON-1650110475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:16:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-522cf36b-3002-4a34-ae02-0f03f38dda0f tempest-AttachVolumeShelveTestJSON-1650110475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:16:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-522cf36b-3002-4a34-ae02-0f03f38dda0f tempest-AttachVolumeShelveTestJSON-1650110475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:16:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-522cf36b-3002-4a34-ae02-0f03f38dda0f tempest-AttachVolumeShelveTestJSON-1650110475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:16:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-522cf36b-3002-4a34-ae02-0f03f38dda0f tempest-AttachVolumeShelveTestJSON-1650110475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:16:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-522cf36b-3002-4a34-ae02-0f03f38dda0f tempest-AttachVolumeShelveTestJSON-1650110475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:34 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:16:34 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:35 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-522cf36b-3002-4a34-ae02-0f03f38dda0f tempest-AttachVolumeShelveTestJSON-1650110475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.463s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:35 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-522cf36b-3002-4a34-ae02-0f03f38dda0f tempest-AttachVolumeShelveTestJSON-1650110475 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:16:35 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-522cf36b-3002-4a34-ae02-0f03f38dda0f tempest-AttachVolumeShelveTestJSON-1650110475 None] Deleted volume successfully. Sep 09 18:16:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-522cf36b-3002-4a34-ae02-0f03f38dda0f tempest-AttachVolumeShelveTestJSON-1650110475 None] Lock "cinder-13c15160-8414-4072-9bb6-f935e7599a89-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:16:38 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:16:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Flow 'volume_create_manager' (75fe3d50-3688-49f5-8259-3b1e05620cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:16:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82868b8b-8c9d-4535-b38a-2e2ee696fbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:16:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82868b8b-8c9d-4535-b38a-2e2ee696fbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2137586493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e902672-59cc-4002-8f05-19d90b6911d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf533d5788404081ba232964067f7e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:16:38Z,use_quota=True,user_id='568ba44d63c946b4bda86d5077620857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:16:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3fd049-2dae-4f75-b5b6-324a4ac50398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:16:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3fd049-2dae-4f75-b5b6-324a4ac50398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:16:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42441bf-d094-49fe-9fdc-58214a8846d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:16:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b42441bf-d094-49fe-9fdc-58214a8846d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e902672-59cc-4002-8f05-19d90b6911d6', 'volume_name': 'volume-8e902672-59cc-4002-8f05-19d90b6911d6', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:16:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e75bc75c-af89-402f-818e-8d78d66023f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:16:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e75bc75c-af89-402f-818e-8d78d66023f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:16:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d13427-9663-4fff-a3f4-41cfe183f342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:16:38 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Volume 8e902672-59cc-4002-8f05-19d90b6911d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e902672-59cc-4002-8f05-19d90b6911d6', 'volume_size': 1} Sep 09 18:16:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:16:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:16:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2137586493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e902672-59cc-4002-8f05-19d90b6911d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf533d5788404081ba232964067f7e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:16:38Z,use_quota=True,user_id='568ba44d63c946b4bda86d5077620857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:16:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Creating volume 8e902672-59cc-4002-8f05-19d90b6911d6 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:16:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:16:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:16:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:16:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:16:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:16:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:16:38 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:16:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8e902672-59cc-4002-8f05-19d90b6911d6 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:38 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8e902672-59cc-4002-8f05-19d90b6911d6 1073741824 Sep 09 18:16:38 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:39 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8e902672-59cc-4002-8f05-19d90b6911d6 1073741824" returned: 0 in 0.815s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8e902672-59cc-4002-8f05-19d90b6911d6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:39 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8e902672-59cc-4002-8f05-19d90b6911d6 Sep 09 18:16:39 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:39 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8e902672-59cc-4002-8f05-19d90b6911d6" returned: 0 in 0.352s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:16:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:16:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d13427-9663-4fff-a3f4-41cfe183f342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e902672-59cc-4002-8f05-19d90b6911d6', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:16:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f144583d-96ac-4528-9417-ce1ef63cedf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:16:39 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Volume volume-8e902672-59cc-4002-8f05-19d90b6911d6 (8e902672-59cc-4002-8f05-19d90b6911d6): created successfully Sep 09 18:16:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f144583d-96ac-4528-9417-ce1ef63cedf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:16:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Flow 'volume_create_manager' (75fe3d50-3688-49f5-8259-3b1e05620cc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:16:39 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-4fd5e80e-4396-432a-90f2-d2583dc7b333 tempest-AttachVolumeNegativeTest-873560772 None] Created volume successfully. Sep 09 18:16:42 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:UPDATE=63,cinder:SELECT=73,cinder:INSERT=19,cinder:DELETE=5 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:16:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-62d92bbd-3825-44a4-b625-0cbc92e22a7f req-7e42b32a-d152-4eac-95d0-b45e2e91926c tempest-AttachVolumeNegativeTest-873560772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:16:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-62d92bbd-3825-44a4-b625-0cbc92e22a7f req-7e42b32a-d152-4eac-95d0-b45e2e91926c tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:16:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-62d92bbd-3825-44a4-b625-0cbc92e22a7f req-7e42b32a-d152-4eac-95d0-b45e2e91926c tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:16:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-62d92bbd-3825-44a4-b625-0cbc92e22a7f req-7e42b32a-d152-4eac-95d0-b45e2e91926c tempest-AttachVolumeNegativeTest-873560772 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-8e902672-59cc-4002-8f05-19d90b6911d6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3226dfc7-5eca-4324-bcef-a584ce6a7f17', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:16:42 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-62d92bbd-3825-44a4-b625-0cbc92e22a7f req-7e42b32a-d152-4eac-95d0-b45e2e91926c tempest-AttachVolumeNegativeTest-873560772 None] attachment_update completed successfully. Sep 09 18:16:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:16:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:16:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:16:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:16:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:16:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:16:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:16:43 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:16:43 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:16:43 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Sep 09 18:16:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.486s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:16:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:16:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:16:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 28 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:16:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:16:46 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=77,cinder:UPDATE=66,cinder:INSERT=20,cinder:DELETE=5 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:16:46 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-38888133-db56-4233-8416-5a05b1bad2e4 req-ced11417-de9f-4233-a466-2e990d053f7a tempest-AttachVolumeNegativeTest-873560772 None] Terminate volume connection completed successfully. Sep 09 18:16:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-38888133-db56-4233-8416-5a05b1bad2e4 req-ced11417-de9f-4233-a466-2e990d053f7a tempest-AttachVolumeNegativeTest-873560772 None] Deleting attachment 3226dfc7-5eca-4324-bcef-a584ce6a7f17. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:16:56 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:UPDATE=2,cinder:SELECT=4 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:17:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dbbd1d44-549d-437f-9657-33f9d892f581 tempest-AttachVolumeNegativeTest-873560772 None] Acquiring lock "cinder-8e902672-59cc-4002-8f05-19d90b6911d6-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dbbd1d44-549d-437f-9657-33f9d892f581 tempest-AttachVolumeNegativeTest-873560772 None] Lock "cinder-8e902672-59cc-4002-8f05-19d90b6911d6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dbbd1d44-549d-437f-9657-33f9d892f581 tempest-AttachVolumeNegativeTest-873560772 None] Acquiring lock "cinder-quobyte-8e902672-59cc-4002-8f05-19d90b6911d6" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dbbd1d44-549d-437f-9657-33f9d892f581 tempest-AttachVolumeNegativeTest-873560772 None] Lock "cinder-quobyte-8e902672-59cc-4002-8f05-19d90b6911d6" acquired by "delete_volume" :: waited 0.028s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:02 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[20682591-65d5-4c22-9bdb-e4669b3a5e32]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:17:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dbbd1d44-549d-437f-9657-33f9d892f581 tempest-AttachVolumeNegativeTest-873560772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8e902672-59cc-4002-8f05-19d90b6911d6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:03 devstack sudo[94753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8e902672-59cc-4002-8f05-19d90b6911d6 Sep 09 18:17:03 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:03 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-9caef5bb-5690-4a4b-96bb-9849c678ab43 req-3b95acfc-b888-41aa-877e-14ef0906ec4d tempest-ServerActionsTestOtherA-1653548153 None] Terminate volume connection completed successfully. Sep 09 18:17:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-9caef5bb-5690-4a4b-96bb-9849c678ab43 req-3b95acfc-b888-41aa-877e-14ef0906ec4d tempest-ServerActionsTestOtherA-1653548153 None] Deleting attachment 33fdca42-440b-4b8b-a6b6-203c2385af73. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:17:03 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dbbd1d44-549d-437f-9657-33f9d892f581 tempest-AttachVolumeNegativeTest-873560772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8e902672-59cc-4002-8f05-19d90b6911d6" returned: 0 in 0.527s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dbbd1d44-549d-437f-9657-33f9d892f581 tempest-AttachVolumeNegativeTest-873560772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8e902672-59cc-4002-8f05-19d90b6911d6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:03 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8e902672-59cc-4002-8f05-19d90b6911d6 Sep 09 18:17:03 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:03 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dbbd1d44-549d-437f-9657-33f9d892f581 tempest-AttachVolumeNegativeTest-873560772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8e902672-59cc-4002-8f05-19d90b6911d6" returned: 0 in 0.319s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dbbd1d44-549d-437f-9657-33f9d892f581 tempest-AttachVolumeNegativeTest-873560772 None] Lock "cinder-quobyte-8e902672-59cc-4002-8f05-19d90b6911d6" released by "delete_volume" :: held 0.925s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:03 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-dbbd1d44-549d-437f-9657-33f9d892f581 tempest-AttachVolumeNegativeTest-873560772 None] Created reservations ['a60f8d0b-040f-48e9-9448-3e2c5a19e834', '40b555e1-0fc6-4940-8441-04310fbe68d0', 'f8cfe371-b578-49b1-918b-3e9beed16055', '25b8eec0-9ba0-41a0-96d6-7567bb9c6c26'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:17:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-dbbd1d44-549d-437f-9657-33f9d892f581 tempest-AttachVolumeNegativeTest-873560772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-dbbd1d44-549d-437f-9657-33f9d892f581 tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-dbbd1d44-549d-437f-9657-33f9d892f581 tempest-AttachVolumeNegativeTest-873560772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-dbbd1d44-549d-437f-9657-33f9d892f581 tempest-AttachVolumeNegativeTest-873560772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-dbbd1d44-549d-437f-9657-33f9d892f581 tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dbbd1d44-549d-437f-9657-33f9d892f581 tempest-AttachVolumeNegativeTest-873560772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:04 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:17:04 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:04 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dbbd1d44-549d-437f-9657-33f9d892f581 tempest-AttachVolumeNegativeTest-873560772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.389s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:04 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-dbbd1d44-549d-437f-9657-33f9d892f581 tempest-AttachVolumeNegativeTest-873560772 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:17:04 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-dbbd1d44-549d-437f-9657-33f9d892f581 tempest-AttachVolumeNegativeTest-873560772 None] Deleted volume successfully. Sep 09 18:17:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dbbd1d44-549d-437f-9657-33f9d892f581 tempest-AttachVolumeNegativeTest-873560772 None] Lock "cinder-8e902672-59cc-4002-8f05-19d90b6911d6-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-58df8141-1321-4e68-9c7c-94aeb65b611a tempest-AttachVolumeNegativeTest-873560772 None] Acquiring lock "cinder-fe11d516-9f90-4f7d-a02f-092c38981bf6-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-58df8141-1321-4e68-9c7c-94aeb65b611a tempest-AttachVolumeNegativeTest-873560772 None] Lock "cinder-fe11d516-9f90-4f7d-a02f-092c38981bf6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-58df8141-1321-4e68-9c7c-94aeb65b611a tempest-AttachVolumeNegativeTest-873560772 None] Acquiring lock "cinder-quobyte-fe11d516-9f90-4f7d-a02f-092c38981bf6" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-58df8141-1321-4e68-9c7c-94aeb65b611a tempest-AttachVolumeNegativeTest-873560772 None] Lock "cinder-quobyte-fe11d516-9f90-4f7d-a02f-092c38981bf6" acquired by "delete_volume" :: waited 0.020s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:05 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd6400b-2a62-4390-b27c-f09d45682644]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:17:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-58df8141-1321-4e68-9c7c-94aeb65b611a tempest-AttachVolumeNegativeTest-873560772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fe11d516-9f90-4f7d-a02f-092c38981bf6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:05 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fe11d516-9f90-4f7d-a02f-092c38981bf6 Sep 09 18:17:05 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:05 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-58df8141-1321-4e68-9c7c-94aeb65b611a tempest-AttachVolumeNegativeTest-873560772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fe11d516-9f90-4f7d-a02f-092c38981bf6" returned: 0 in 0.471s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-58df8141-1321-4e68-9c7c-94aeb65b611a tempest-AttachVolumeNegativeTest-873560772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fe11d516-9f90-4f7d-a02f-092c38981bf6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:05 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fe11d516-9f90-4f7d-a02f-092c38981bf6 Sep 09 18:17:05 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:06 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-58df8141-1321-4e68-9c7c-94aeb65b611a tempest-AttachVolumeNegativeTest-873560772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fe11d516-9f90-4f7d-a02f-092c38981bf6" returned: 0 in 0.302s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:06 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-58df8141-1321-4e68-9c7c-94aeb65b611a tempest-AttachVolumeNegativeTest-873560772 None] Lock "cinder-quobyte-fe11d516-9f90-4f7d-a02f-092c38981bf6" released by "delete_volume" :: held 0.829s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:06 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-58df8141-1321-4e68-9c7c-94aeb65b611a tempest-AttachVolumeNegativeTest-873560772 None] Created reservations ['0124ac93-97bf-4a82-baeb-644262080998', '04c782b7-5b06-4330-9f06-4a763da7f35d', 'e0d69aa8-9cab-407c-8b66-f4043ea088f4', 'a04f0484-8446-4bc6-8fef-8d623868d6c6'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:17:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-58df8141-1321-4e68-9c7c-94aeb65b611a tempest-AttachVolumeNegativeTest-873560772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-58df8141-1321-4e68-9c7c-94aeb65b611a tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-58df8141-1321-4e68-9c7c-94aeb65b611a tempest-AttachVolumeNegativeTest-873560772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-58df8141-1321-4e68-9c7c-94aeb65b611a tempest-AttachVolumeNegativeTest-873560772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-58df8141-1321-4e68-9c7c-94aeb65b611a tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-58df8141-1321-4e68-9c7c-94aeb65b611a tempest-AttachVolumeNegativeTest-873560772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:06 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:17:06 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:06 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-58df8141-1321-4e68-9c7c-94aeb65b611a tempest-AttachVolumeNegativeTest-873560772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.367s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:06 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-58df8141-1321-4e68-9c7c-94aeb65b611a tempest-AttachVolumeNegativeTest-873560772 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:17:06 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-58df8141-1321-4e68-9c7c-94aeb65b611a tempest-AttachVolumeNegativeTest-873560772 None] Deleted volume successfully. Sep 09 18:17:06 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-58df8141-1321-4e68-9c7c-94aeb65b611a tempest-AttachVolumeNegativeTest-873560772 None] Lock "cinder-fe11d516-9f90-4f7d-a02f-092c38981bf6-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:06 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-606adf8a-be82-4be6-ac2e-67dcacca4184 tempest-AttachVolumeNegativeTest-873560772 None] Acquiring lock "cinder-1185262d-c09a-4cf1-b78e-f046348e49b5-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:06 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-606adf8a-be82-4be6-ac2e-67dcacca4184 tempest-AttachVolumeNegativeTest-873560772 None] Lock "cinder-1185262d-c09a-4cf1-b78e-f046348e49b5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:06 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-606adf8a-be82-4be6-ac2e-67dcacca4184 tempest-AttachVolumeNegativeTest-873560772 None] Acquiring lock "cinder-quobyte-1185262d-c09a-4cf1-b78e-f046348e49b5" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:06 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-606adf8a-be82-4be6-ac2e-67dcacca4184 tempest-AttachVolumeNegativeTest-873560772 None] Lock "cinder-quobyte-1185262d-c09a-4cf1-b78e-f046348e49b5" acquired by "delete_volume" :: waited 0.028s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:06 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf47797-7a76-434f-880c-653a31c04a1a]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:17:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-606adf8a-be82-4be6-ac2e-67dcacca4184 tempest-AttachVolumeNegativeTest-873560772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1185262d-c09a-4cf1-b78e-f046348e49b5 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:06 devstack sudo[94783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1185262d-c09a-4cf1-b78e-f046348e49b5 Sep 09 18:17:06 devstack sudo[94783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:07 devstack sudo[94783]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-606adf8a-be82-4be6-ac2e-67dcacca4184 tempest-AttachVolumeNegativeTest-873560772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1185262d-c09a-4cf1-b78e-f046348e49b5" returned: 0 in 0.439s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-606adf8a-be82-4be6-ac2e-67dcacca4184 tempest-AttachVolumeNegativeTest-873560772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1185262d-c09a-4cf1-b78e-f046348e49b5 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:07 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1185262d-c09a-4cf1-b78e-f046348e49b5 Sep 09 18:17:07 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:07 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-606adf8a-be82-4be6-ac2e-67dcacca4184 tempest-AttachVolumeNegativeTest-873560772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1185262d-c09a-4cf1-b78e-f046348e49b5" returned: 0 in 0.419s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:07 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-606adf8a-be82-4be6-ac2e-67dcacca4184 tempest-AttachVolumeNegativeTest-873560772 None] Lock "cinder-quobyte-1185262d-c09a-4cf1-b78e-f046348e49b5" released by "delete_volume" :: held 0.914s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:07 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-606adf8a-be82-4be6-ac2e-67dcacca4184 tempest-AttachVolumeNegativeTest-873560772 None] Created reservations ['06d48f99-b1fd-40c9-a8bb-2d4a58b3bcc7', 'c72504f8-bad8-48a8-8f6b-e793f3a18b10', 'dc2c9145-82ab-4320-9972-4009f4e3527b', '0d877e6c-8ba1-498b-a2ce-17bc480b5065'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:17:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-606adf8a-be82-4be6-ac2e-67dcacca4184 tempest-AttachVolumeNegativeTest-873560772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-606adf8a-be82-4be6-ac2e-67dcacca4184 tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-606adf8a-be82-4be6-ac2e-67dcacca4184 tempest-AttachVolumeNegativeTest-873560772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-606adf8a-be82-4be6-ac2e-67dcacca4184 tempest-AttachVolumeNegativeTest-873560772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-606adf8a-be82-4be6-ac2e-67dcacca4184 tempest-AttachVolumeNegativeTest-873560772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-606adf8a-be82-4be6-ac2e-67dcacca4184 tempest-AttachVolumeNegativeTest-873560772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:07 devstack sudo[94792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:17:07 devstack sudo[94792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:08 devstack sudo[94792]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-606adf8a-be82-4be6-ac2e-67dcacca4184 tempest-AttachVolumeNegativeTest-873560772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.344s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:08 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-606adf8a-be82-4be6-ac2e-67dcacca4184 tempest-AttachVolumeNegativeTest-873560772 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:17:08 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-606adf8a-be82-4be6-ac2e-67dcacca4184 tempest-AttachVolumeNegativeTest-873560772 None] Deleted volume successfully. Sep 09 18:17:08 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-606adf8a-be82-4be6-ac2e-67dcacca4184 tempest-AttachVolumeNegativeTest-873560772 None] Lock "cinder-1185262d-c09a-4cf1-b78e-f046348e49b5-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-9caef5bb-5690-4a4b-96bb-9849c678ab43 req-1365bb6d-6084-432d-98fb-f498e35d4287 tempest-ServerActionsTestOtherA-1653548153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-9caef5bb-5690-4a4b-96bb-9849c678ab43 req-1365bb6d-6084-432d-98fb-f498e35d4287 tempest-ServerActionsTestOtherA-1653548153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-9caef5bb-5690-4a4b-96bb-9849c678ab43 req-1365bb6d-6084-432d-98fb-f498e35d4287 tempest-ServerActionsTestOtherA-1653548153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-9caef5bb-5690-4a4b-96bb-9849c678ab43 req-1365bb6d-6084-432d-98fb-f498e35d4287 tempest-ServerActionsTestOtherA-1653548153 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-1e710e2d-2163-41fe-9942-afded99d053c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '599b6cc5-293d-4c22-808e-5079c01d6f76', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:17:10 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-9caef5bb-5690-4a4b-96bb-9849c678ab43 req-1365bb6d-6084-432d-98fb-f498e35d4287 tempest-ServerActionsTestOtherA-1653548153 None] attachment_update completed successfully. Sep 09 18:17:20 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:UPDATE=25,cinder:SELECT=21,cinder:INSERT=4 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:17:20 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=24,cinder:INSERT=8,cinder:UPDATE=26,cinder:DELETE=3 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:17:26 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:17:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Flow 'volume_create_manager' (9607aa92-313d-4598-aa5b-97611d8d8849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:17:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e865f5-e4a4-4aef-afc8-4ac4b6b2f6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e865f5-e4a4-4aef-afc8-4ac4b6b2f6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1946898098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41cafce-7601-4f26-be01-043a18294a6f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='920c87afd0aa4dc297152861cc5f754d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:17:26Z,use_quota=True,user_id='78904de1044f4cdcbc2b0c3515c4a83e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ab05e8-8e2c-469e-9445-aae6a0c5aaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ab05e8-8e2c-469e-9445-aae6a0c5aaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8942a911-0665-49f3-962d-8ef216cc963a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8942a911-0665-49f3-962d-8ef216cc963a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a41cafce-7601-4f26-be01-043a18294a6f', 'volume_name': 'volume-a41cafce-7601-4f26-be01-043a18294a6f', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c52c66-d469-4a02-8307-1efa13de0dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c52c66-d469-4a02-8307-1efa13de0dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add37322-9549-4266-afa2-30bca33ab83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:26 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Volume a41cafce-7601-4f26-be01-043a18294a6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a41cafce-7601-4f26-be01-043a18294a6f', 'volume_size': 1} Sep 09 18:17:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1946898098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a41cafce-7601-4f26-be01-043a18294a6f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='920c87afd0aa4dc297152861cc5f754d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:17:26Z,use_quota=True,user_id='78904de1044f4cdcbc2b0c3515c4a83e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:17:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Creating volume a41cafce-7601-4f26-be01-043a18294a6f {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:17:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:17:26 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:17:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a41cafce-7601-4f26-be01-043a18294a6f 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:26 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a41cafce-7601-4f26-be01-043a18294a6f 1073741824 Sep 09 18:17:26 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:27 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:17:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Flow 'volume_create_manager' (ffdd8e66-713b-40a0-8ee4-24fb2814bcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:17:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d0baa8-ec4c-4c30-9cfe-f3452b7a310a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d0baa8-ec4c-4c30-9cfe-f3452b7a310a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1994001232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e9893c-45da-44c6-b582-f13dbf8f34ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6e714d225e049f2ad71142579310374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:17:27Z,use_quota=True,user_id='be4a20e652e44c08b3779081c4b3d8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a393cbb1-28ed-4674-8990-8072305febee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a393cbb1-28ed-4674-8990-8072305febee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17350628-a4eb-478c-b8fa-36d64dbd73d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17350628-a4eb-478c-b8fa-36d64dbd73d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64e9893c-45da-44c6-b582-f13dbf8f34ff', 'volume_name': 'volume-64e9893c-45da-44c6-b582-f13dbf8f34ff', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4d295d-fa20-42f2-90f8-cb1a633d790e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4d295d-fa20-42f2-90f8-cb1a633d790e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96597acc-3cb4-4e75-909d-c60fc3464811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:27 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Volume 64e9893c-45da-44c6-b582-f13dbf8f34ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64e9893c-45da-44c6-b582-f13dbf8f34ff', 'volume_size': 1} Sep 09 18:17:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:27 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a41cafce-7601-4f26-be01-043a18294a6f 1073741824" returned: 0 in 0.961s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a41cafce-7601-4f26-be01-043a18294a6f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:27 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a41cafce-7601-4f26-be01-043a18294a6f Sep 09 18:17:27 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:28 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a41cafce-7601-4f26-be01-043a18294a6f" returned: 0 in 0.451s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:17:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.794s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1994001232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64e9893c-45da-44c6-b582-f13dbf8f34ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6e714d225e049f2ad71142579310374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:17:27Z,use_quota=True,user_id='be4a20e652e44c08b3779081c4b3d8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:17:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Creating volume 64e9893c-45da-44c6-b582-f13dbf8f34ff {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:17:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:17:28 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:17:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-64e9893c-45da-44c6-b582-f13dbf8f34ff 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add37322-9549-4266-afa2-30bca33ab83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a41cafce-7601-4f26-be01-043a18294a6f', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:28 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-64e9893c-45da-44c6-b582-f13dbf8f34ff 1073741824 Sep 09 18:17:28 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c78887-f1ed-4064-b530-d6e654dd8243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:28 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Volume volume-a41cafce-7601-4f26-be01-043a18294a6f (a41cafce-7601-4f26-be01-043a18294a6f): created successfully Sep 09 18:17:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c78887-f1ed-4064-b530-d6e654dd8243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Flow 'volume_create_manager' (9607aa92-313d-4598-aa5b-97611d8d8849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:17:28 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-758d489f-ec63-4f5c-8531-35c7c33ce898 tempest-VolumesTestJSON-690323015 None] Created volume successfully. Sep 09 18:17:29 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-64e9893c-45da-44c6-b582-f13dbf8f34ff 1073741824" returned: 0 in 0.842s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-64e9893c-45da-44c6-b582-f13dbf8f34ff {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:29 devstack sudo[95434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-64e9893c-45da-44c6-b582-f13dbf8f34ff Sep 09 18:17:29 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:29 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-64e9893c-45da-44c6-b582-f13dbf8f34ff" returned: 0 in 0.506s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:17:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96597acc-3cb4-4e75-909d-c60fc3464811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64e9893c-45da-44c6-b582-f13dbf8f34ff', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caec33f6-fb77-4902-b5cb-7f2ea3f4c63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:29 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Volume volume-64e9893c-45da-44c6-b582-f13dbf8f34ff (64e9893c-45da-44c6-b582-f13dbf8f34ff): created successfully Sep 09 18:17:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caec33f6-fb77-4902-b5cb-7f2ea3f4c63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Flow 'volume_create_manager' (ffdd8e66-713b-40a0-8ee4-24fb2814bcf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:17:29 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-b6cadd9d-aaca-4a85-ba3d-dd122ded0b43 tempest-VolumesActionsTest-1360657215 None] Created volume successfully. Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Flow 'volume_create_manager' (f7a21b19-d3cd-4c41-8001-dab519879e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed580126-78da-436c-85cf-a5c326193363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed580126-78da-436c-85cf-a5c326193363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1258585257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51aa3889-6d27-4422-bfd9-18ea5b11b1c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='920c87afd0aa4dc297152861cc5f754d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:17:30Z,use_quota=True,user_id='78904de1044f4cdcbc2b0c3515c4a83e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2a4c08-b7af-426d-9d98-89bc74c66daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2a4c08-b7af-426d-9d98-89bc74c66daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc5d727-15b6-4db3-bb8a-de5c6f0f27ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc5d727-15b6-4db3-bb8a-de5c6f0f27ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51aa3889-6d27-4422-bfd9-18ea5b11b1c0', 'volume_name': 'volume-51aa3889-6d27-4422-bfd9-18ea5b11b1c0', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4edc92-a3eb-4a5f-87ef-7a700303fb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4edc92-a3eb-4a5f-87ef-7a700303fb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10dcf427-1fb2-4600-9734-c35705dc1dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:30 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Volume 51aa3889-6d27-4422-bfd9-18ea5b11b1c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51aa3889-6d27-4422-bfd9-18ea5b11b1c0', 'volume_size': 1} Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1258585257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51aa3889-6d27-4422-bfd9-18ea5b11b1c0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='920c87afd0aa4dc297152861cc5f754d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:17:30Z,use_quota=True,user_id='78904de1044f4cdcbc2b0c3515c4a83e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Creating volume 51aa3889-6d27-4422-bfd9-18ea5b11b1c0 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:17:30 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51aa3889-6d27-4422-bfd9-18ea5b11b1c0 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:30 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51aa3889-6d27-4422-bfd9-18ea5b11b1c0 1073741824 Sep 09 18:17:30 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4605822e-68e3-4619-b9ed-21074f43e066 tempest-VolumesActionsTest-1360657215 None] Acquiring lock "cinder-64e9893c-45da-44c6-b582-f13dbf8f34ff" by "attach_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4605822e-68e3-4619-b9ed-21074f43e066 tempest-VolumesActionsTest-1360657215 None] Lock "cinder-64e9893c-45da-44c6-b582-f13dbf8f34ff" acquired by "attach_volume" :: waited 0.038s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:30 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-4605822e-68e3-4619-b9ed-21074f43e066 tempest-VolumesActionsTest-1360657215 None] Attaching volume 64e9893c-45da-44c6-b582-f13dbf8f34ff to instance 2e26e389-d5d0-4eb8-9032-3ac45f8f5601 at mountpoint /dev/vdb on host None. Sep 09 18:17:30 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-4605822e-68e3-4619-b9ed-21074f43e066 tempest-VolumesActionsTest-1360657215 None] Attach volume completed successfully. Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4605822e-68e3-4619-b9ed-21074f43e066 tempest-VolumesActionsTest-1360657215 None] Lock "cinder-64e9893c-45da-44c6-b582-f13dbf8f34ff" released by "attach_volume" :: held 0.218s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:30 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51aa3889-6d27-4422-bfd9-18ea5b11b1c0 1073741824" returned: 0 in 0.780s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51aa3889-6d27-4422-bfd9-18ea5b11b1c0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:31 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51aa3889-6d27-4422-bfd9-18ea5b11b1c0 Sep 09 18:17:31 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:31 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51aa3889-6d27-4422-bfd9-18ea5b11b1c0" returned: 0 in 0.413s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:17:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10dcf427-1fb2-4600-9734-c35705dc1dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51aa3889-6d27-4422-bfd9-18ea5b11b1c0', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c7290b-7634-48d4-87b2-d4a2cca269ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:31 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Volume volume-51aa3889-6d27-4422-bfd9-18ea5b11b1c0 (51aa3889-6d27-4422-bfd9-18ea5b11b1c0): created successfully Sep 09 18:17:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c7290b-7634-48d4-87b2-d4a2cca269ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Flow 'volume_create_manager' (f7a21b19-d3cd-4c41-8001-dab519879e5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:17:31 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-2c4a2075-6b72-437a-938e-0fb69aabcf3e tempest-VolumesTestJSON-690323015 None] Created volume successfully. Sep 09 18:17:32 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-9efe357e-ff29-478f-8e09-1591266e735c tempest-VolumesActionsTest-517549068 None] Terminate volume connection completed successfully. Sep 09 18:17:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9efe357e-ff29-478f-8e09-1591266e735c tempest-VolumesActionsTest-517549068 None] Acquiring lock "cinder-64e9893c-45da-44c6-b582-f13dbf8f34ff-detach_volume" by "detach_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9efe357e-ff29-478f-8e09-1591266e735c tempest-VolumesActionsTest-517549068 None] Lock "cinder-64e9893c-45da-44c6-b582-f13dbf8f34ff-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:32 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-9efe357e-ff29-478f-8e09-1591266e735c tempest-VolumesActionsTest-517549068 None] Detaching volume 64e9893c-45da-44c6-b582-f13dbf8f34ff from instance 2e26e389-d5d0-4eb8-9032-3ac45f8f5601. Sep 09 18:17:32 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-9efe357e-ff29-478f-8e09-1591266e735c tempest-VolumesActionsTest-517549068 None] Detach volume completed successfully. Sep 09 18:17:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9efe357e-ff29-478f-8e09-1591266e735c tempest-VolumesActionsTest-517549068 None] Lock "cinder-64e9893c-45da-44c6-b582-f13dbf8f34ff-detach_volume" released by "detach_volume" :: held 0.206s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4b1d1bbc-6731-4a97-97ed-5f1c76e31744 tempest-VolumesActionsTest-1360657215 None] Acquiring lock "cinder-64e9893c-45da-44c6-b582-f13dbf8f34ff-detach_volume" by "detach_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4b1d1bbc-6731-4a97-97ed-5f1c76e31744 tempest-VolumesActionsTest-1360657215 None] Lock "cinder-64e9893c-45da-44c6-b582-f13dbf8f34ff-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:32 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-4b1d1bbc-6731-4a97-97ed-5f1c76e31744 tempest-VolumesActionsTest-1360657215 None] Volume detach called, but volume not attached. Sep 09 18:17:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4b1d1bbc-6731-4a97-97ed-5f1c76e31744 tempest-VolumesActionsTest-1360657215 None] Lock "cinder-64e9893c-45da-44c6-b582-f13dbf8f34ff-detach_volume" released by "detach_volume" :: held 0.049s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Flow 'volume_create_manager' (0ad03f31-edfd-41e1-9955-f433a87485b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e16152e-af54-4528-935b-0a03ac2ed2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e16152e-af54-4528-935b-0a03ac2ed2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1818899759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81007c65-08e3-4733-acba-6bd7ffaad567,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='920c87afd0aa4dc297152861cc5f754d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:17:33Z,use_quota=True,user_id='78904de1044f4cdcbc2b0c3515c4a83e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b980c5-f067-4f9d-8873-fd15c688fa0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b980c5-f067-4f9d-8873-fd15c688fa0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671af1ad-7256-40ca-9204-84b32daef81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671af1ad-7256-40ca-9204-84b32daef81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81007c65-08e3-4733-acba-6bd7ffaad567', 'volume_name': 'volume-81007c65-08e3-4733-acba-6bd7ffaad567', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72349eff-21d4-49aa-9bd2-3321a78cd844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72349eff-21d4-49aa-9bd2-3321a78cd844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adbf9ee6-aa82-477e-9f18-3dbde9cb410d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:33 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Volume 81007c65-08e3-4733-acba-6bd7ffaad567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81007c65-08e3-4733-acba-6bd7ffaad567', 'volume_size': 1} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1818899759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81007c65-08e3-4733-acba-6bd7ffaad567,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='920c87afd0aa4dc297152861cc5f754d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:17:33Z,use_quota=True,user_id='78904de1044f4cdcbc2b0c3515c4a83e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Creating volume 81007c65-08e3-4733-acba-6bd7ffaad567 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:17:33 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-81007c65-08e3-4733-acba-6bd7ffaad567 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3b394262-0b66-4a76-8c67-43f34160219d tempest-VolumesActionsTest-1360657215 None] Acquiring lock "cinder-64e9893c-45da-44c6-b582-f13dbf8f34ff-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:33 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-81007c65-08e3-4733-acba-6bd7ffaad567 1073741824 Sep 09 18:17:33 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3b394262-0b66-4a76-8c67-43f34160219d tempest-VolumesActionsTest-1360657215 None] Lock "cinder-64e9893c-45da-44c6-b582-f13dbf8f34ff-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3b394262-0b66-4a76-8c67-43f34160219d tempest-VolumesActionsTest-1360657215 None] Acquiring lock "cinder-quobyte-64e9893c-45da-44c6-b582-f13dbf8f34ff" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3b394262-0b66-4a76-8c67-43f34160219d tempest-VolumesActionsTest-1360657215 None] Lock "cinder-quobyte-64e9893c-45da-44c6-b582-f13dbf8f34ff" acquired by "delete_volume" :: waited 0.024s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb14519d-1f85-4819-9e30-adf4ebab6913]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:17:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3b394262-0b66-4a76-8c67-43f34160219d tempest-VolumesActionsTest-1360657215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-64e9893c-45da-44c6-b582-f13dbf8f34ff {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:33 devstack sudo[95476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-64e9893c-45da-44c6-b582-f13dbf8f34ff Sep 09 18:17:33 devstack sudo[95476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:34 devstack sudo[95476]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3b394262-0b66-4a76-8c67-43f34160219d tempest-VolumesActionsTest-1360657215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-64e9893c-45da-44c6-b582-f13dbf8f34ff" returned: 0 in 0.530s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3b394262-0b66-4a76-8c67-43f34160219d tempest-VolumesActionsTest-1360657215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-64e9893c-45da-44c6-b582-f13dbf8f34ff {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:34 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-64e9893c-45da-44c6-b582-f13dbf8f34ff Sep 09 18:17:34 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:34 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-81007c65-08e3-4733-acba-6bd7ffaad567 1073741824" returned: 0 in 0.920s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-81007c65-08e3-4733-acba-6bd7ffaad567 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:34 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-81007c65-08e3-4733-acba-6bd7ffaad567 Sep 09 18:17:34 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:34 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3b394262-0b66-4a76-8c67-43f34160219d tempest-VolumesActionsTest-1360657215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-64e9893c-45da-44c6-b582-f13dbf8f34ff" returned: 0 in 0.488s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3b394262-0b66-4a76-8c67-43f34160219d tempest-VolumesActionsTest-1360657215 None] Lock "cinder-quobyte-64e9893c-45da-44c6-b582-f13dbf8f34ff" released by "delete_volume" :: held 1.089s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:34 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-3b394262-0b66-4a76-8c67-43f34160219d tempest-VolumesActionsTest-1360657215 None] Created reservations ['6fb8e839-65ef-45a9-bea6-1a70d8b23192', 'a4c13a0f-8f70-4545-ac6b-55dc1ae87b51', '439768cb-3620-49c3-8e1c-26ed6a60552d', '440706e7-be24-4643-9836-eb70f49dea66'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:17:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3b394262-0b66-4a76-8c67-43f34160219d tempest-VolumesActionsTest-1360657215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3b394262-0b66-4a76-8c67-43f34160219d tempest-VolumesActionsTest-1360657215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3b394262-0b66-4a76-8c67-43f34160219d tempest-VolumesActionsTest-1360657215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3b394262-0b66-4a76-8c67-43f34160219d tempest-VolumesActionsTest-1360657215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3b394262-0b66-4a76-8c67-43f34160219d tempest-VolumesActionsTest-1360657215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3b394262-0b66-4a76-8c67-43f34160219d tempest-VolumesActionsTest-1360657215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:34 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-81007c65-08e3-4733-acba-6bd7ffaad567" returned: 0 in 0.575s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:17:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:35 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:17:35 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adbf9ee6-aa82-477e-9f18-3dbde9cb410d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81007c65-08e3-4733-acba-6bd7ffaad567', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5f1dde-8c42-4c40-8c23-2ab099936e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:35 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Volume volume-81007c65-08e3-4733-acba-6bd7ffaad567 (81007c65-08e3-4733-acba-6bd7ffaad567): created successfully Sep 09 18:17:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5f1dde-8c42-4c40-8c23-2ab099936e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Flow 'volume_create_manager' (0ad03f31-edfd-41e1-9955-f433a87485b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:17:35 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-6a76b0e5-e7e6-478b-ae17-975a1f158648 tempest-VolumesTestJSON-690323015 None] Created volume successfully. Sep 09 18:17:35 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3b394262-0b66-4a76-8c67-43f34160219d tempest-VolumesActionsTest-1360657215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.342s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:35 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-3b394262-0b66-4a76-8c67-43f34160219d tempest-VolumesActionsTest-1360657215 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:17:35 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-3b394262-0b66-4a76-8c67-43f34160219d tempest-VolumesActionsTest-1360657215 None] Deleted volume successfully. Sep 09 18:17:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3b394262-0b66-4a76-8c67-43f34160219d tempest-VolumesActionsTest-1360657215 None] Lock "cinder-64e9893c-45da-44c6-b582-f13dbf8f34ff-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ea1106df-8d22-46e4-828a-eb7edfba8d62 tempest-VolumesTestJSON-690323015 None] Acquiring lock "cinder-81007c65-08e3-4733-acba-6bd7ffaad567-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ea1106df-8d22-46e4-828a-eb7edfba8d62 tempest-VolumesTestJSON-690323015 None] Lock "cinder-81007c65-08e3-4733-acba-6bd7ffaad567-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ea1106df-8d22-46e4-828a-eb7edfba8d62 tempest-VolumesTestJSON-690323015 None] Acquiring lock "cinder-quobyte-81007c65-08e3-4733-acba-6bd7ffaad567" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ea1106df-8d22-46e4-828a-eb7edfba8d62 tempest-VolumesTestJSON-690323015 None] Lock "cinder-quobyte-81007c65-08e3-4733-acba-6bd7ffaad567" acquired by "delete_volume" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:36 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff008936-6d11-4549-baca-0a12ef0b5f64]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:17:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ea1106df-8d22-46e4-828a-eb7edfba8d62 tempest-VolumesTestJSON-690323015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-81007c65-08e3-4733-acba-6bd7ffaad567 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:37 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-81007c65-08e3-4733-acba-6bd7ffaad567 Sep 09 18:17:37 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:37 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ea1106df-8d22-46e4-828a-eb7edfba8d62 tempest-VolumesTestJSON-690323015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-81007c65-08e3-4733-acba-6bd7ffaad567" returned: 0 in 0.523s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ea1106df-8d22-46e4-828a-eb7edfba8d62 tempest-VolumesTestJSON-690323015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-81007c65-08e3-4733-acba-6bd7ffaad567 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:37 devstack sudo[95533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-81007c65-08e3-4733-acba-6bd7ffaad567 Sep 09 18:17:37 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:37 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ea1106df-8d22-46e4-828a-eb7edfba8d62 tempest-VolumesTestJSON-690323015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-81007c65-08e3-4733-acba-6bd7ffaad567" returned: 0 in 0.358s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ea1106df-8d22-46e4-828a-eb7edfba8d62 tempest-VolumesTestJSON-690323015 None] Lock "cinder-quobyte-81007c65-08e3-4733-acba-6bd7ffaad567" released by "delete_volume" :: held 0.966s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:37 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-ea1106df-8d22-46e4-828a-eb7edfba8d62 tempest-VolumesTestJSON-690323015 None] Created reservations ['f525548a-445f-4121-a40d-86da25c8bc70', '5d1760b9-0dad-4c45-9ab6-13c06ad1a46a', '1fcc9439-6fef-4d8c-a9a5-7594330d84c3', 'a1e6675d-9957-4084-82cc-4f0e3e7ed2b2'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:17:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ea1106df-8d22-46e4-828a-eb7edfba8d62 tempest-VolumesTestJSON-690323015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ea1106df-8d22-46e4-828a-eb7edfba8d62 tempest-VolumesTestJSON-690323015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ea1106df-8d22-46e4-828a-eb7edfba8d62 tempest-VolumesTestJSON-690323015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ea1106df-8d22-46e4-828a-eb7edfba8d62 tempest-VolumesTestJSON-690323015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ea1106df-8d22-46e4-828a-eb7edfba8d62 tempest-VolumesTestJSON-690323015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ea1106df-8d22-46e4-828a-eb7edfba8d62 tempest-VolumesTestJSON-690323015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:37 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:17:37 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:38 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ea1106df-8d22-46e4-828a-eb7edfba8d62 tempest-VolumesTestJSON-690323015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.267s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:38 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-ea1106df-8d22-46e4-828a-eb7edfba8d62 tempest-VolumesTestJSON-690323015 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:17:38 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ea1106df-8d22-46e4-828a-eb7edfba8d62 tempest-VolumesTestJSON-690323015 None] Deleted volume successfully. Sep 09 18:17:38 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ea1106df-8d22-46e4-828a-eb7edfba8d62 tempest-VolumesTestJSON-690323015 None] Lock "cinder-81007c65-08e3-4733-acba-6bd7ffaad567-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:38 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8a0193e6-c23c-4901-96d3-4aae78d0d81a tempest-VolumesTestJSON-690323015 None] Acquiring lock "cinder-51aa3889-6d27-4422-bfd9-18ea5b11b1c0-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8a0193e6-c23c-4901-96d3-4aae78d0d81a tempest-VolumesTestJSON-690323015 None] Lock "cinder-51aa3889-6d27-4422-bfd9-18ea5b11b1c0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8a0193e6-c23c-4901-96d3-4aae78d0d81a tempest-VolumesTestJSON-690323015 None] Acquiring lock "cinder-quobyte-51aa3889-6d27-4422-bfd9-18ea5b11b1c0" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8a0193e6-c23c-4901-96d3-4aae78d0d81a tempest-VolumesTestJSON-690323015 None] Lock "cinder-quobyte-51aa3889-6d27-4422-bfd9-18ea5b11b1c0" acquired by "delete_volume" :: waited 0.038s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8c3d2b-1e62-49e6-b5c0-b70a002e249f]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8a0193e6-c23c-4901-96d3-4aae78d0d81a tempest-VolumesTestJSON-690323015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51aa3889-6d27-4422-bfd9-18ea5b11b1c0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:39 devstack sudo[95540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51aa3889-6d27-4422-bfd9-18ea5b11b1c0 Sep 09 18:17:39 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Flow 'volume_create_manager' (3db42699-229e-45c1-9b10-2fe12618dd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54fcaf2-09a4-4e41-84ef-e9c811380180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54fcaf2-09a4-4e41-84ef-e9c811380180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-107776510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2419e9-eb75-49f5-ab8e-62659c6ee20f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6e714d225e049f2ad71142579310374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:17:39Z,use_quota=True,user_id='be4a20e652e44c08b3779081c4b3d8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c929ca3-345a-4de1-95ca-e601eeff14d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c929ca3-345a-4de1-95ca-e601eeff14d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8302421e-bccf-413f-afb1-1fd84a59878f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8302421e-bccf-413f-afb1-1fd84a59878f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f2419e9-eb75-49f5-ab8e-62659c6ee20f', 'volume_name': 'volume-7f2419e9-eb75-49f5-ab8e-62659c6ee20f', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9003dd2d-b9dc-4f21-b5a2-464d40fc16af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9003dd2d-b9dc-4f21-b5a2-464d40fc16af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038768f2-7e3b-4745-8a30-902dc0f324e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:39 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Volume 7f2419e9-eb75-49f5-ab8e-62659c6ee20f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f2419e9-eb75-49f5-ab8e-62659c6ee20f', 'volume_size': 1} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:39 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-107776510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2419e9-eb75-49f5-ab8e-62659c6ee20f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6e714d225e049f2ad71142579310374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:17:39Z,use_quota=True,user_id='be4a20e652e44c08b3779081c4b3d8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Creating volume 7f2419e9-eb75-49f5-ab8e-62659c6ee20f {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:17:39 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7f2419e9-eb75-49f5-ab8e-62659c6ee20f 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8a0193e6-c23c-4901-96d3-4aae78d0d81a tempest-VolumesTestJSON-690323015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51aa3889-6d27-4422-bfd9-18ea5b11b1c0" returned: 0 in 0.452s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8a0193e6-c23c-4901-96d3-4aae78d0d81a tempest-VolumesTestJSON-690323015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51aa3889-6d27-4422-bfd9-18ea5b11b1c0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:39 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7f2419e9-eb75-49f5-ab8e-62659c6ee20f 1073741824 Sep 09 18:17:39 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:39 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51aa3889-6d27-4422-bfd9-18ea5b11b1c0 Sep 09 18:17:39 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:39 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8a0193e6-c23c-4901-96d3-4aae78d0d81a tempest-VolumesTestJSON-690323015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51aa3889-6d27-4422-bfd9-18ea5b11b1c0" returned: 0 in 0.260s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8a0193e6-c23c-4901-96d3-4aae78d0d81a tempest-VolumesTestJSON-690323015 None] Lock "cinder-quobyte-51aa3889-6d27-4422-bfd9-18ea5b11b1c0" released by "delete_volume" :: held 0.765s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:39 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-8a0193e6-c23c-4901-96d3-4aae78d0d81a tempest-VolumesTestJSON-690323015 None] Created reservations ['38c00c58-2793-4987-809c-402420bb165a', '785df937-8d27-47b4-b929-00326c28abbf', 'ef245a01-7c03-44cf-a475-1eb5ae87d0c0', '01d14fe1-af6a-4c49-930e-115d566f42a6'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8a0193e6-c23c-4901-96d3-4aae78d0d81a tempest-VolumesTestJSON-690323015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8a0193e6-c23c-4901-96d3-4aae78d0d81a tempest-VolumesTestJSON-690323015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8a0193e6-c23c-4901-96d3-4aae78d0d81a tempest-VolumesTestJSON-690323015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8a0193e6-c23c-4901-96d3-4aae78d0d81a tempest-VolumesTestJSON-690323015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8a0193e6-c23c-4901-96d3-4aae78d0d81a tempest-VolumesTestJSON-690323015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8a0193e6-c23c-4901-96d3-4aae78d0d81a tempest-VolumesTestJSON-690323015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:40 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7f2419e9-eb75-49f5-ab8e-62659c6ee20f 1073741824" returned: 0 in 0.477s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:40 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:17:40 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7f2419e9-eb75-49f5-ab8e-62659c6ee20f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:40 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7f2419e9-eb75-49f5-ab8e-62659c6ee20f Sep 09 18:17:40 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-56d742e9-6fb4-4e94-9ce0-8f51a04de893 tempest-VolumesTestJSON-690323015 None] Acquiring lock "cinder-a41cafce-7601-4f26-be01-043a18294a6f-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-56d742e9-6fb4-4e94-9ce0-8f51a04de893 tempest-VolumesTestJSON-690323015 None] Lock "cinder-a41cafce-7601-4f26-be01-043a18294a6f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-56d742e9-6fb4-4e94-9ce0-8f51a04de893 tempest-VolumesTestJSON-690323015 None] Acquiring lock "cinder-quobyte-a41cafce-7601-4f26-be01-043a18294a6f" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-56d742e9-6fb4-4e94-9ce0-8f51a04de893 tempest-VolumesTestJSON-690323015 None] Lock "cinder-quobyte-a41cafce-7601-4f26-be01-043a18294a6f" acquired by "delete_volume" :: waited 0.028s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[419601f8-6b68-4be1-aad9-1f57c5f1a98a]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-56d742e9-6fb4-4e94-9ce0-8f51a04de893 tempest-VolumesTestJSON-690323015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a41cafce-7601-4f26-be01-043a18294a6f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:40 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8a0193e6-c23c-4901-96d3-4aae78d0d81a tempest-VolumesTestJSON-690323015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.412s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-8a0193e6-c23c-4901-96d3-4aae78d0d81a tempest-VolumesTestJSON-690323015 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:17:40 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-8a0193e6-c23c-4901-96d3-4aae78d0d81a tempest-VolumesTestJSON-690323015 None] Deleted volume successfully. Sep 09 18:17:40 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8a0193e6-c23c-4901-96d3-4aae78d0d81a tempest-VolumesTestJSON-690323015 None] Lock "cinder-51aa3889-6d27-4422-bfd9-18ea5b11b1c0-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7f2419e9-eb75-49f5-ab8e-62659c6ee20f" returned: 0 in 0.399s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038768f2-7e3b-4745-8a30-902dc0f324e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f2419e9-eb75-49f5-ab8e-62659c6ee20f', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258bc122-0e5f-4189-9327-485d61843a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:40 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Volume volume-7f2419e9-eb75-49f5-ab8e-62659c6ee20f (7f2419e9-eb75-49f5-ab8e-62659c6ee20f): created successfully Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258bc122-0e5f-4189-9327-485d61843a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:40 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a41cafce-7601-4f26-be01-043a18294a6f Sep 09 18:17:40 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Flow 'volume_create_manager' (3db42699-229e-45c1-9b10-2fe12618dd02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:17:40 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-f30b6a35-a545-4e53-b59b-4e1d5520d64e tempest-VolumesActionsTest-1360657215 None] Created volume successfully. Sep 09 18:17:40 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-56d742e9-6fb4-4e94-9ce0-8f51a04de893 tempest-VolumesTestJSON-690323015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a41cafce-7601-4f26-be01-043a18294a6f" returned: 0 in 0.421s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-56d742e9-6fb4-4e94-9ce0-8f51a04de893 tempest-VolumesTestJSON-690323015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a41cafce-7601-4f26-be01-043a18294a6f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:40 devstack sudo[95591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a41cafce-7601-4f26-be01-043a18294a6f Sep 09 18:17:40 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:41 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-56d742e9-6fb4-4e94-9ce0-8f51a04de893 tempest-VolumesTestJSON-690323015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a41cafce-7601-4f26-be01-043a18294a6f" returned: 0 in 0.255s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:41 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-56d742e9-6fb4-4e94-9ce0-8f51a04de893 tempest-VolumesTestJSON-690323015 None] Lock "cinder-quobyte-a41cafce-7601-4f26-be01-043a18294a6f" released by "delete_volume" :: held 0.728s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:41 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-56d742e9-6fb4-4e94-9ce0-8f51a04de893 tempest-VolumesTestJSON-690323015 None] Created reservations ['02b33a48-f4f6-48f9-9d1b-fc056a0144ea', 'a54fbf84-e104-4617-a362-503ae8a27f5f', 'fc01b29e-b1a0-418f-aecf-cfd36969e75b', '2d4c1e04-7b83-4ae3-a998-f49dae8a4152'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:17:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-56d742e9-6fb4-4e94-9ce0-8f51a04de893 tempest-VolumesTestJSON-690323015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-56d742e9-6fb4-4e94-9ce0-8f51a04de893 tempest-VolumesTestJSON-690323015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:41 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-56d742e9-6fb4-4e94-9ce0-8f51a04de893 tempest-VolumesTestJSON-690323015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:41 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-56d742e9-6fb4-4e94-9ce0-8f51a04de893 tempest-VolumesTestJSON-690323015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-56d742e9-6fb4-4e94-9ce0-8f51a04de893 tempest-VolumesTestJSON-690323015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-56d742e9-6fb4-4e94-9ce0-8f51a04de893 tempest-VolumesTestJSON-690323015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:41 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:17:41 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:41 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-56d742e9-6fb4-4e94-9ce0-8f51a04de893 tempest-VolumesTestJSON-690323015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.260s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:41 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-56d742e9-6fb4-4e94-9ce0-8f51a04de893 tempest-VolumesTestJSON-690323015 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:17:41 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-56d742e9-6fb4-4e94-9ce0-8f51a04de893 tempest-VolumesTestJSON-690323015 None] Deleted volume successfully. Sep 09 18:17:41 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-56d742e9-6fb4-4e94-9ce0-8f51a04de893 tempest-VolumesTestJSON-690323015 None] Lock "cinder-a41cafce-7601-4f26-be01-043a18294a6f-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:41 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0e431e69-33a4-4d6f-a8d2-9415d4ff4778 tempest-VolumesActionsTest-517549068 None] Acquiring lock "cinder-7f2419e9-eb75-49f5-ab8e-62659c6ee20f-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:41 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0e431e69-33a4-4d6f-a8d2-9415d4ff4778 tempest-VolumesActionsTest-517549068 None] Lock "cinder-7f2419e9-eb75-49f5-ab8e-62659c6ee20f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:41 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0e431e69-33a4-4d6f-a8d2-9415d4ff4778 tempest-VolumesActionsTest-517549068 None] Acquiring lock "cinder-quobyte-7f2419e9-eb75-49f5-ab8e-62659c6ee20f" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:41 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0e431e69-33a4-4d6f-a8d2-9415d4ff4778 tempest-VolumesActionsTest-517549068 None] Lock "cinder-quobyte-7f2419e9-eb75-49f5-ab8e-62659c6ee20f" acquired by "delete_volume" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:41 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3ee1c6-fa79-448e-981b-cb9ccdec79bf]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:17:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0e431e69-33a4-4d6f-a8d2-9415d4ff4778 tempest-VolumesActionsTest-517549068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7f2419e9-eb75-49f5-ab8e-62659c6ee20f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:41 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7f2419e9-eb75-49f5-ab8e-62659c6ee20f Sep 09 18:17:41 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:42 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0e431e69-33a4-4d6f-a8d2-9415d4ff4778 tempest-VolumesActionsTest-517549068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7f2419e9-eb75-49f5-ab8e-62659c6ee20f" returned: 0 in 0.382s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0e431e69-33a4-4d6f-a8d2-9415d4ff4778 tempest-VolumesActionsTest-517549068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7f2419e9-eb75-49f5-ab8e-62659c6ee20f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:42 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7f2419e9-eb75-49f5-ab8e-62659c6ee20f Sep 09 18:17:42 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:42 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0e431e69-33a4-4d6f-a8d2-9415d4ff4778 tempest-VolumesActionsTest-517549068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7f2419e9-eb75-49f5-ab8e-62659c6ee20f" returned: 0 in 0.265s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0e431e69-33a4-4d6f-a8d2-9415d4ff4778 tempest-VolumesActionsTest-517549068 None] Lock "cinder-quobyte-7f2419e9-eb75-49f5-ab8e-62659c6ee20f" released by "delete_volume" :: held 0.689s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:42 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-0e431e69-33a4-4d6f-a8d2-9415d4ff4778 tempest-VolumesActionsTest-517549068 None] Created reservations ['0b645a3e-c764-49c1-82e4-b7f9bcaac743', '059c9743-eac9-4824-a60e-7c2e9843de2c', '4b36bf5e-f2a6-4f25-a54c-9158a666d372', '7ada172b-4009-45d1-bd7a-ff0e4fdd9a5d'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:17:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0e431e69-33a4-4d6f-a8d2-9415d4ff4778 tempest-VolumesActionsTest-517549068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0e431e69-33a4-4d6f-a8d2-9415d4ff4778 tempest-VolumesActionsTest-517549068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0e431e69-33a4-4d6f-a8d2-9415d4ff4778 tempest-VolumesActionsTest-517549068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0e431e69-33a4-4d6f-a8d2-9415d4ff4778 tempest-VolumesActionsTest-517549068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0e431e69-33a4-4d6f-a8d2-9415d4ff4778 tempest-VolumesActionsTest-517549068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0e431e69-33a4-4d6f-a8d2-9415d4ff4778 tempest-VolumesActionsTest-517549068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:42 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:17:42 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:42 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0e431e69-33a4-4d6f-a8d2-9415d4ff4778 tempest-VolumesActionsTest-517549068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.324s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:42 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-0e431e69-33a4-4d6f-a8d2-9415d4ff4778 tempest-VolumesActionsTest-517549068 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:17:43 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-0e431e69-33a4-4d6f-a8d2-9415d4ff4778 tempest-VolumesActionsTest-517549068 None] Deleted volume successfully. Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0e431e69-33a4-4d6f-a8d2-9415d4ff4778 tempest-VolumesActionsTest-517549068 None] Lock "cinder-7f2419e9-eb75-49f5-ab8e-62659c6ee20f-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:43 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:17:43 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:43 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.413s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 28 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Flow 'volume_create_manager' (9fc0794c-71ae-44f1-87af-4add60b1b653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f758a6e5-e5dd-4a68-baa1-8229fb47e146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f758a6e5-e5dd-4a68-baa1-8229fb47e146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-276820498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f077bf97-4fc2-4532-b3e2-32fb36fd0bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6e714d225e049f2ad71142579310374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:17:44Z,use_quota=True,user_id='be4a20e652e44c08b3779081c4b3d8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e0499b-17c8-4e92-b9c3-53b52f5fe9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e0499b-17c8-4e92-b9c3-53b52f5fe9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be0c342-00eb-4e48-b26e-6ebf0d059f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be0c342-00eb-4e48-b26e-6ebf0d059f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f077bf97-4fc2-4532-b3e2-32fb36fd0bf6', 'volume_name': 'volume-f077bf97-4fc2-4532-b3e2-32fb36fd0bf6', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0dcaff-51b3-4291-8e03-e3cd6fb668e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df0dcaff-51b3-4291-8e03-e3cd6fb668e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a22b33-ece9-4f18-ba4b-9f50feec8bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:43 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Volume f077bf97-4fc2-4532-b3e2-32fb36fd0bf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f077bf97-4fc2-4532-b3e2-32fb36fd0bf6', 'volume_size': 1} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-276820498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f077bf97-4fc2-4532-b3e2-32fb36fd0bf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6e714d225e049f2ad71142579310374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:17:44Z,use_quota=True,user_id='be4a20e652e44c08b3779081c4b3d8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Creating volume f077bf97-4fc2-4532-b3e2-32fb36fd0bf6 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:17:43 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:17:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f077bf97-4fc2-4532-b3e2-32fb36fd0bf6 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:43 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f077bf97-4fc2-4532-b3e2-32fb36fd0bf6 1073741824 Sep 09 18:17:43 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:44 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f077bf97-4fc2-4532-b3e2-32fb36fd0bf6 1073741824" returned: 0 in 0.487s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f077bf97-4fc2-4532-b3e2-32fb36fd0bf6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:44 devstack sudo[95618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f077bf97-4fc2-4532-b3e2-32fb36fd0bf6 Sep 09 18:17:44 devstack sudo[95618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:44 devstack sudo[95618]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f077bf97-4fc2-4532-b3e2-32fb36fd0bf6" returned: 0 in 0.280s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:44 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:17:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:44 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a22b33-ece9-4f18-ba4b-9f50feec8bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f077bf97-4fc2-4532-b3e2-32fb36fd0bf6', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:44 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eba9c4b-4ee7-401c-b8a2-36361d887f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:44 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Volume volume-f077bf97-4fc2-4532-b3e2-32fb36fd0bf6 (f077bf97-4fc2-4532-b3e2-32fb36fd0bf6): created successfully Sep 09 18:17:44 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eba9c4b-4ee7-401c-b8a2-36361d887f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:44 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Flow 'volume_create_manager' (9fc0794c-71ae-44f1-87af-4add60b1b653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:17:44 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-630b6b34-b24c-44d8-a230-ceead716b191 tempest-VolumesActionsTest-1360657215 None] Created volume successfully. Sep 09 18:17:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-efa1e877-5271-4a63-816f-a689615956af tempest-VolumesActionsTest-517549068 None] Acquiring lock "cinder-f077bf97-4fc2-4532-b3e2-32fb36fd0bf6-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-efa1e877-5271-4a63-816f-a689615956af tempest-VolumesActionsTest-517549068 None] Lock "cinder-f077bf97-4fc2-4532-b3e2-32fb36fd0bf6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-efa1e877-5271-4a63-816f-a689615956af tempest-VolumesActionsTest-517549068 None] Acquiring lock "cinder-quobyte-f077bf97-4fc2-4532-b3e2-32fb36fd0bf6" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-efa1e877-5271-4a63-816f-a689615956af tempest-VolumesActionsTest-517549068 None] Lock "cinder-quobyte-f077bf97-4fc2-4532-b3e2-32fb36fd0bf6" acquired by "delete_volume" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:46 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[755cbe67-c980-453b-890f-b9054efe3d88]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:17:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-efa1e877-5271-4a63-816f-a689615956af tempest-VolumesActionsTest-517549068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f077bf97-4fc2-4532-b3e2-32fb36fd0bf6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:46 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f077bf97-4fc2-4532-b3e2-32fb36fd0bf6 Sep 09 18:17:46 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:46 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-6a971fbe-33d9-4636-9b86-835a60d70a78 tempest-GroupsV314Test-1145777028 None] Group tempest-GroupsV314Test-Group-872909270: creating Sep 09 18:17:46 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-6a971fbe-33d9-4636-9b86-835a60d70a78 tempest-GroupsV314Test-1145777028 None] Group tempest-GroupsV314Test-Group-872909270: created successfully Sep 09 18:17:46 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-6a971fbe-33d9-4636-9b86-835a60d70a78 tempest-GroupsV314Test-1145777028 None] Create group completed successfully. Sep 09 18:17:46 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-efa1e877-5271-4a63-816f-a689615956af tempest-VolumesActionsTest-517549068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f077bf97-4fc2-4532-b3e2-32fb36fd0bf6" returned: 0 in 0.378s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-efa1e877-5271-4a63-816f-a689615956af tempest-VolumesActionsTest-517549068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f077bf97-4fc2-4532-b3e2-32fb36fd0bf6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:46 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f077bf97-4fc2-4532-b3e2-32fb36fd0bf6 Sep 09 18:17:46 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:46 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-efa1e877-5271-4a63-816f-a689615956af tempest-VolumesActionsTest-517549068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f077bf97-4fc2-4532-b3e2-32fb36fd0bf6" returned: 0 in 0.245s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:46 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-efa1e877-5271-4a63-816f-a689615956af tempest-VolumesActionsTest-517549068 None] Lock "cinder-quobyte-f077bf97-4fc2-4532-b3e2-32fb36fd0bf6" released by "delete_volume" :: held 0.672s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:46 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-efa1e877-5271-4a63-816f-a689615956af tempest-VolumesActionsTest-517549068 None] Created reservations ['6e4319b9-324d-4389-892b-f67a0f778f9f', '5da8fad1-a023-4a6a-9a2b-a3bb8b37faba', '33e85dab-3a6e-4f4e-a888-8185f3f58b55', '5ed2fde2-512f-49ba-85c0-a267b89de93b'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:17:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-efa1e877-5271-4a63-816f-a689615956af tempest-VolumesActionsTest-517549068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-efa1e877-5271-4a63-816f-a689615956af tempest-VolumesActionsTest-517549068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:46 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-efa1e877-5271-4a63-816f-a689615956af tempest-VolumesActionsTest-517549068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:46 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-efa1e877-5271-4a63-816f-a689615956af tempest-VolumesActionsTest-517549068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-efa1e877-5271-4a63-816f-a689615956af tempest-VolumesActionsTest-517549068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-efa1e877-5271-4a63-816f-a689615956af tempest-VolumesActionsTest-517549068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:46 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:17:46 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:47 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-efa1e877-5271-4a63-816f-a689615956af tempest-VolumesActionsTest-517549068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.244s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-efa1e877-5271-4a63-816f-a689615956af tempest-VolumesActionsTest-517549068 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:17:47 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-efa1e877-5271-4a63-816f-a689615956af tempest-VolumesActionsTest-517549068 None] Deleted volume successfully. Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-efa1e877-5271-4a63-816f-a689615956af tempest-VolumesActionsTest-517549068 None] Lock "cinder-f077bf97-4fc2-4532-b3e2-32fb36fd0bf6-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Flow 'volume_create_manager' (007e1d1a-b102-4615-b47e-125afb974a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55df3df5-a4c8-4b31-bc6b-477f253a4c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55df3df5-a4c8-4b31-bc6b-477f253a4c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1805488996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146054c8-9927-450b-9186-dd1f0e6f296e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6e714d225e049f2ad71142579310374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:17:48Z,use_quota=True,user_id='be4a20e652e44c08b3779081c4b3d8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4480109b-21e3-4f14-b9b9-a5374e08b2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4480109b-21e3-4f14-b9b9-a5374e08b2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25ea82b-86ba-4c9d-a679-9b0c7c84e9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25ea82b-86ba-4c9d-a679-9b0c7c84e9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '146054c8-9927-450b-9186-dd1f0e6f296e', 'volume_name': 'volume-146054c8-9927-450b-9186-dd1f0e6f296e', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172b2447-7e18-4230-a1e4-bfd282e922b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172b2447-7e18-4230-a1e4-bfd282e922b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d442ad3-710f-48bb-a514-4de9444f8fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:47 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Volume 146054c8-9927-450b-9186-dd1f0e6f296e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-146054c8-9927-450b-9186-dd1f0e6f296e', 'volume_size': 1} Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1805488996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146054c8-9927-450b-9186-dd1f0e6f296e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6e714d225e049f2ad71142579310374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:17:48Z,use_quota=True,user_id='be4a20e652e44c08b3779081c4b3d8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Creating volume 146054c8-9927-450b-9186-dd1f0e6f296e {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:17:47 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:17:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-146054c8-9927-450b-9186-dd1f0e6f296e 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:47 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-146054c8-9927-450b-9186-dd1f0e6f296e 1073741824 Sep 09 18:17:47 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Flow 'volume_create_manager' (f5efa908-8d62-430b-9388-c6d449a2043c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b3bb73-5b23-48cd-9c39-947e9418aa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b3bb73-5b23-48cd-9c39-947e9418aa6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-712603705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=40aa4caf-44a6-4420-b9e4-b4cb42a9e3c1,host='devstack@QuobyteHD#QuobyteHD',id=6d7af1da-c2fb-4491-af4d-fe9e36ce381a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6f01b0afee47848414dfc271a3399f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:17:48Z,use_quota=True,user_id='ab324e859e3f4ba4ae57b9344353a0ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13c50a12-68e1-49d8-9af3-e41e44fadfa8),volume_type_id=13c50a12-68e1-49d8-9af3-e41e44fadfa8)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a73040-c96a-4d92-ab60-9267e4da0662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a73040-c96a-4d92-ab60-9267e4da0662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a429ccc9-920d-4f6f-9ee6-90c3fe239742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a429ccc9-920d-4f6f-9ee6-90c3fe239742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d7af1da-c2fb-4491-af4d-fe9e36ce381a', 'volume_name': 'volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09e4b75-2e6a-43f0-9470-3a380c4713ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c09e4b75-2e6a-43f0-9470-3a380c4713ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa3b985-b3d8-4fd1-b1e5-2e1a3dd18986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:48 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Volume 6d7af1da-c2fb-4491-af4d-fe9e36ce381a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a', 'volume_size': 1} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:48 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-146054c8-9927-450b-9186-dd1f0e6f296e 1073741824" returned: 0 in 0.595s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-146054c8-9927-450b-9186-dd1f0e6f296e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:48 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-146054c8-9927-450b-9186-dd1f0e6f296e Sep 09 18:17:48 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:48 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-146054c8-9927-450b-9186-dd1f0e6f296e" returned: 0 in 0.349s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.534s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=40aa4caf-44a6-4420-b9e4-b4cb42a9e3c1,created_at=2026-09-09T16:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-712603705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=40aa4caf-44a6-4420-b9e4-b4cb42a9e3c1,host='devstack@QuobyteHD#QuobyteHD',id=6d7af1da-c2fb-4491-af4d-fe9e36ce381a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f6f01b0afee47848414dfc271a3399f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:17:48Z,use_quota=True,user_id='ab324e859e3f4ba4ae57b9344353a0ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13c50a12-68e1-49d8-9af3-e41e44fadfa8),volume_type_id=13c50a12-68e1-49d8-9af3-e41e44fadfa8)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Creating volume 6d7af1da-c2fb-4491-af4d-fe9e36ce381a {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:17:48 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:48 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a 1073741824 Sep 09 18:17:48 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d442ad3-710f-48bb-a514-4de9444f8fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-146054c8-9927-450b-9186-dd1f0e6f296e', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c9b068-4358-4a45-9a05-33cdb2942467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:48 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Volume volume-146054c8-9927-450b-9186-dd1f0e6f296e (146054c8-9927-450b-9186-dd1f0e6f296e): created successfully Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90c9b068-4358-4a45-9a05-33cdb2942467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Flow 'volume_create_manager' (007e1d1a-b102-4615-b47e-125afb974a3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:17:48 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-565fc3c7-3c96-4328-9326-6b3e1c16fbec tempest-VolumesActionsTest-1360657215 None] Created volume successfully. Sep 09 18:17:49 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a 1073741824" returned: 0 in 0.750s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:49 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a Sep 09 18:17:49 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:49 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a" returned: 0 in 0.279s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:49 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:17:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa3b985-b3d8-4fd1-b1e5-2e1a3dd18986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fccd99c-b91f-4ad9-9cd3-555966d28bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:49 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Volume volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a (6d7af1da-c2fb-4491-af4d-fe9e36ce381a): created successfully Sep 09 18:17:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fccd99c-b91f-4ad9-9cd3-555966d28bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Flow 'volume_create_manager' (f5efa908-8d62-430b-9388-c6d449a2043c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:17:49 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-df7ea0e7-f87b-4bf4-ba90-4ebf1a8a6a42 tempest-GroupsV314Test-1145777028 None] Created volume successfully. Sep 09 18:17:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e1de4320-0e84-4d58-90f3-4bac58e79bcc tempest-VolumesActionsTest-517549068 None] Acquiring lock "cinder-146054c8-9927-450b-9186-dd1f0e6f296e-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e1de4320-0e84-4d58-90f3-4bac58e79bcc tempest-VolumesActionsTest-517549068 None] Lock "cinder-146054c8-9927-450b-9186-dd1f0e6f296e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e1de4320-0e84-4d58-90f3-4bac58e79bcc tempest-VolumesActionsTest-517549068 None] Acquiring lock "cinder-quobyte-146054c8-9927-450b-9186-dd1f0e6f296e" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e1de4320-0e84-4d58-90f3-4bac58e79bcc tempest-VolumesActionsTest-517549068 None] Lock "cinder-quobyte-146054c8-9927-450b-9186-dd1f0e6f296e" acquired by "delete_volume" :: waited 0.026s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:50 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bc22c8-88a7-4ea4-b030-a1d6977af75a]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:17:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e1de4320-0e84-4d58-90f3-4bac58e79bcc tempest-VolumesActionsTest-517549068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-146054c8-9927-450b-9186-dd1f0e6f296e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:50 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-146054c8-9927-450b-9186-dd1f0e6f296e Sep 09 18:17:50 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:50 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e1de4320-0e84-4d58-90f3-4bac58e79bcc tempest-VolumesActionsTest-517549068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-146054c8-9927-450b-9186-dd1f0e6f296e" returned: 0 in 0.485s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e1de4320-0e84-4d58-90f3-4bac58e79bcc tempest-VolumesActionsTest-517549068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-146054c8-9927-450b-9186-dd1f0e6f296e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:50 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-146054c8-9927-450b-9186-dd1f0e6f296e Sep 09 18:17:50 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:51 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e1de4320-0e84-4d58-90f3-4bac58e79bcc tempest-VolumesActionsTest-517549068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-146054c8-9927-450b-9186-dd1f0e6f296e" returned: 0 in 0.369s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e1de4320-0e84-4d58-90f3-4bac58e79bcc tempest-VolumesActionsTest-517549068 None] Lock "cinder-quobyte-146054c8-9927-450b-9186-dd1f0e6f296e" released by "delete_volume" :: held 0.918s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:51 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-e6582789-026b-4bb8-ae70-f3b50343205d req-3aff228c-67b4-4cf3-ab5f-711654c5e513 tempest-ServerActionsTestOtherA-1653548153 None] Terminate volume connection completed successfully. Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-e6582789-026b-4bb8-ae70-f3b50343205d req-3aff228c-67b4-4cf3-ab5f-711654c5e513 tempest-ServerActionsTestOtherA-1653548153 None] Deleting attachment 599b6cc5-293d-4c22-808e-5079c01d6f76. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-e1de4320-0e84-4d58-90f3-4bac58e79bcc tempest-VolumesActionsTest-517549068 None] Created reservations ['3dde8e71-1888-4341-ad5d-4a544142940f', 'b0f6ef85-9915-4f01-9724-d7e814577799', 'b3f09807-80ce-4e1a-b7f9-3d6941333aaa', '17b6cd1c-1054-4431-acb4-0cb41cdcbddf'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e1de4320-0e84-4d58-90f3-4bac58e79bcc tempest-VolumesActionsTest-517549068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e1de4320-0e84-4d58-90f3-4bac58e79bcc tempest-VolumesActionsTest-517549068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e1de4320-0e84-4d58-90f3-4bac58e79bcc tempest-VolumesActionsTest-517549068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e1de4320-0e84-4d58-90f3-4bac58e79bcc tempest-VolumesActionsTest-517549068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e1de4320-0e84-4d58-90f3-4bac58e79bcc tempest-VolumesActionsTest-517549068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e1de4320-0e84-4d58-90f3-4bac58e79bcc tempest-VolumesActionsTest-517549068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:17:51 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:17:51 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Flow 'volume_create_manager' (4326fc58-a8f7-442a-bd01-0d524ef5264b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3fa601-988e-468b-9c2f-e4ff22ed95d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-e6582789-026b-4bb8-ae70-f3b50343205d req-d89cf072-854a-4e45-b91c-30b204ac0c6c tempest-ServerActionsTestOtherA-1653548153 None] Acquiring lock "cinder-1e710e2d-2163-41fe-9942-afded99d053c-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3fa601-988e-468b-9c2f-e4ff22ed95d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1963235550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6183f299-1344-47b7-8a3f-dd8a31d16ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659e26cec29d4ab99adec9eb58d93f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:17:51Z,use_quota=True,user_id='94c641d7c5e14e23b1cee39769e64447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe90dd8e-9808-4d23-b35b-f17316b2ab3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe90dd8e-9808-4d23-b35b-f17316b2ab3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb3f28f-6a45-4f73-9db3-ebe205fec55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb3f28f-6a45-4f73-9db3-ebe205fec55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6183f299-1344-47b7-8a3f-dd8a31d16ab6', 'volume_name': 'volume-6183f299-1344-47b7-8a3f-dd8a31d16ab6', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1292f63c-cc6a-4f1a-9af2-6d73ac5a13dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1292f63c-cc6a-4f1a-9af2-6d73ac5a13dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98edf2a-c681-4f6f-b630-b20b42deb154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:51 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Volume 6183f299-1344-47b7-8a3f-dd8a31d16ab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6183f299-1344-47b7-8a3f-dd8a31d16ab6', 'volume_size': 1} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1963235550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6183f299-1344-47b7-8a3f-dd8a31d16ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659e26cec29d4ab99adec9eb58d93f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:17:51Z,use_quota=True,user_id='94c641d7c5e14e23b1cee39769e64447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Creating volume 6183f299-1344-47b7-8a3f-dd8a31d16ab6 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:17:51 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6183f299-1344-47b7-8a3f-dd8a31d16ab6 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:51 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6183f299-1344-47b7-8a3f-dd8a31d16ab6 1073741824 Sep 09 18:17:51 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-e6582789-026b-4bb8-ae70-f3b50343205d req-d89cf072-854a-4e45-b91c-30b204ac0c6c tempest-ServerActionsTestOtherA-1653548153 None] Lock "cinder-1e710e2d-2163-41fe-9942-afded99d053c-delete_volume" acquired by "delete_volume" :: waited 0.238s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-e6582789-026b-4bb8-ae70-f3b50343205d req-d89cf072-854a-4e45-b91c-30b204ac0c6c tempest-ServerActionsTestOtherA-1653548153 None] Acquiring lock "cinder-quobyte-1e710e2d-2163-41fe-9942-afded99d053c" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-e6582789-026b-4bb8-ae70-f3b50343205d req-d89cf072-854a-4e45-b91c-30b204ac0c6c tempest-ServerActionsTestOtherA-1653548153 None] Lock "cinder-quobyte-1e710e2d-2163-41fe-9942-afded99d053c" acquired by "delete_volume" :: waited 0.028s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[37473079-dc07-465a-a53f-0f76ef19a01b]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-e6582789-026b-4bb8-ae70-f3b50343205d req-d89cf072-854a-4e45-b91c-30b204ac0c6c tempest-ServerActionsTestOtherA-1653548153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e710e2d-2163-41fe-9942-afded99d053c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:51 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e1de4320-0e84-4d58-90f3-4bac58e79bcc tempest-VolumesActionsTest-517549068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.634s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-e1de4320-0e84-4d58-90f3-4bac58e79bcc tempest-VolumesActionsTest-517549068 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:17:51 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-e1de4320-0e84-4d58-90f3-4bac58e79bcc tempest-VolumesActionsTest-517549068 None] Deleted volume successfully. Sep 09 18:17:51 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e710e2d-2163-41fe-9942-afded99d053c Sep 09 18:17:51 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e1de4320-0e84-4d58-90f3-4bac58e79bcc tempest-VolumesActionsTest-517549068 None] Lock "cinder-146054c8-9927-450b-9186-dd1f0e6f296e-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:52 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6183f299-1344-47b7-8a3f-dd8a31d16ab6 1073741824" returned: 0 in 0.719s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6183f299-1344-47b7-8a3f-dd8a31d16ab6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:52 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6183f299-1344-47b7-8a3f-dd8a31d16ab6 Sep 09 18:17:52 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:52 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-e6582789-026b-4bb8-ae70-f3b50343205d req-d89cf072-854a-4e45-b91c-30b204ac0c6c tempest-ServerActionsTestOtherA-1653548153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e710e2d-2163-41fe-9942-afded99d053c" returned: 0 in 0.510s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-e6582789-026b-4bb8-ae70-f3b50343205d req-d89cf072-854a-4e45-b91c-30b204ac0c6c tempest-ServerActionsTestOtherA-1653548153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e710e2d-2163-41fe-9942-afded99d053c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:52 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e710e2d-2163-41fe-9942-afded99d053c Sep 09 18:17:52 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Flow 'volume_create_manager' (79c80c4c-2f6a-456b-81b1-94647ba95754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02b79b1-027d-4b84-b1fd-5102f083f849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02b79b1-027d-4b84-b1fd-5102f083f849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1633149187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15a2153-6849-40e8-9db0-c08329553f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6e714d225e049f2ad71142579310374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:17:52Z,use_quota=True,user_id='be4a20e652e44c08b3779081c4b3d8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5761af-af19-4ab6-b24c-86dc2b02c94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5761af-af19-4ab6-b24c-86dc2b02c94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092874c1-af47-4d6a-a57c-6fddf344e505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092874c1-af47-4d6a-a57c-6fddf344e505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd15a2153-6849-40e8-9db0-c08329553f9a', 'volume_name': 'volume-d15a2153-6849-40e8-9db0-c08329553f9a', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db88a4a-0dcc-4e63-9998-3273882bc2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6db88a4a-0dcc-4e63-9998-3273882bc2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22fb3c7-63da-439a-bff0-7a050a547922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:52 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Volume d15a2153-6849-40e8-9db0-c08329553f9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d15a2153-6849-40e8-9db0-c08329553f9a', 'volume_size': 1} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:52 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6183f299-1344-47b7-8a3f-dd8a31d16ab6" returned: 0 in 0.252s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.822s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:52 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Cloning volume 6d7af1da-c2fb-4491-af4d-fe9e36ce381a to volume 345605c5-4f72-4bdc-ab14-5256fa101d86 Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98edf2a-c681-4f6f-b630-b20b42deb154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6183f299-1344-47b7-8a3f-dd8a31d16ab6', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3973dccc-b515-4826-a840-971f6b7e8008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:17:52 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Volume volume-6183f299-1344-47b7-8a3f-dd8a31d16ab6 (6183f299-1344-47b7-8a3f-dd8a31d16ab6): created successfully Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3973dccc-b515-4826-a840-971f6b7e8008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Flow 'volume_create_manager' (4326fc58-a8f7-442a-bd01-0d524ef5264b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:17:52 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Creating offline snapshot cba2a486-94b6-423b-9bae-5e5b459636c0 of volume 6d7af1da-c2fb-4491-af4d-fe9e36ce381a {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-e6582789-026b-4bb8-ae70-f3b50343205d req-d89cf072-854a-4e45-b91c-30b204ac0c6c tempest-ServerActionsTestOtherA-1653548153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e710e2d-2163-41fe-9942-afded99d053c" returned: 0 in 0.273s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:52 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d9dda47c-2b15-4dbf-82ff-78cfc68160fd tempest-AttachVolumeTestJSON-1359511233 None] Created volume successfully. Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6761ca-80ba-4a03-a4b4-655c38cc41b9]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-e6582789-026b-4bb8-ae70-f3b50343205d req-d89cf072-854a-4e45-b91c-30b204ac0c6c tempest-ServerActionsTestOtherA-1653548153 None] Lock "cinder-quobyte-1e710e2d-2163-41fe-9942-afded99d053c" released by "delete_volume" :: held 0.892s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.quota [req-e6582789-026b-4bb8-ae70-f3b50343205d req-d89cf072-854a-4e45-b91c-30b204ac0c6c tempest-ServerActionsTestOtherA-1653548153 None] Created reservations ['1ebbd51a-70dc-4d50-9539-7800a5889142', '56ba57ff-2832-4862-b3ca-86645e3a7a6b', '0331fa6b-9b27-4093-b129-5e4448432ac9', '66348232-b4f7-42b9-b4be-2a6a1bda54f3'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:17:52 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a Sep 09 18:17:52 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-e6582789-026b-4bb8-ae70-f3b50343205d req-d89cf072-854a-4e45-b91c-30b204ac0c6c tempest-ServerActionsTestOtherA-1653548153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-e6582789-026b-4bb8-ae70-f3b50343205d req-d89cf072-854a-4e45-b91c-30b204ac0c6c tempest-ServerActionsTestOtherA-1653548153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [req-e6582789-026b-4bb8-ae70-f3b50343205d req-d89cf072-854a-4e45-b91c-30b204ac0c6c tempest-ServerActionsTestOtherA-1653548153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [req-e6582789-026b-4bb8-ae70-f3b50343205d req-d89cf072-854a-4e45-b91c-30b204ac0c6c tempest-ServerActionsTestOtherA-1653548153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-e6582789-026b-4bb8-ae70-f3b50343205d req-d89cf072-854a-4e45-b91c-30b204ac0c6c tempest-ServerActionsTestOtherA-1653548153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-e6582789-026b-4bb8-ae70-f3b50343205d req-d89cf072-854a-4e45-b91c-30b204ac0c6c tempest-ServerActionsTestOtherA-1653548153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-81722dc6-647d-4cc8-bba4-4abee36fc652 tempest-ServerActionsTestOtherA-1653548153 None] Acquiring lock "cinder-067421d7-c8b7-4251-ac05-67bc21a2c9be-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:52 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:17:52 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-81722dc6-647d-4cc8-bba4-4abee36fc652 tempest-ServerActionsTestOtherA-1653548153 None] Lock "cinder-067421d7-c8b7-4251-ac05-67bc21a2c9be-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-81722dc6-647d-4cc8-bba4-4abee36fc652 tempest-ServerActionsTestOtherA-1653548153 None] Acquiring lock "cinder-quobyte-067421d7-c8b7-4251-ac05-67bc21a2c9be" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-81722dc6-647d-4cc8-bba4-4abee36fc652 tempest-ServerActionsTestOtherA-1653548153 None] Lock "cinder-quobyte-067421d7-c8b7-4251-ac05-67bc21a2c9be" acquired by "delete_volume" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0725b0b2-3940-409a-bb34-877a909409af]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-81722dc6-647d-4cc8-bba4-4abee36fc652 tempest-ServerActionsTestOtherA-1653548153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-067421d7-c8b7-4251-ac05-67bc21a2c9be {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:52 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-067421d7-c8b7-4251-ac05-67bc21a2c9be Sep 09 18:17:52 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:52 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a" returned: 0 in 0.418s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:53 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0 1G Sep 09 18:17:53 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:53 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-e6582789-026b-4bb8-ae70-f3b50343205d req-d89cf072-854a-4e45-b91c-30b204ac0c6c tempest-ServerActionsTestOtherA-1653548153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.322s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:53 devstack cinder-volume[87639]: DEBUG cinder.manager [req-e6582789-026b-4bb8-ae70-f3b50343205d req-d89cf072-854a-4e45-b91c-30b204ac0c6c tempest-ServerActionsTestOtherA-1653548153 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:17:53 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-e6582789-026b-4bb8-ae70-f3b50343205d req-d89cf072-854a-4e45-b91c-30b204ac0c6c tempest-ServerActionsTestOtherA-1653548153 None] Deleted volume successfully. Sep 09 18:17:53 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-e6582789-026b-4bb8-ae70-f3b50343205d req-d89cf072-854a-4e45-b91c-30b204ac0c6c tempest-ServerActionsTestOtherA-1653548153 None] Lock "cinder-1e710e2d-2163-41fe-9942-afded99d053c-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:53 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-81722dc6-647d-4cc8-bba4-4abee36fc652 tempest-ServerActionsTestOtherA-1653548153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-067421d7-c8b7-4251-ac05-67bc21a2c9be" returned: 0 in 0.452s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-81722dc6-647d-4cc8-bba4-4abee36fc652 tempest-ServerActionsTestOtherA-1653548153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-067421d7-c8b7-4251-ac05-67bc21a2c9be {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:53 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-067421d7-c8b7-4251-ac05-67bc21a2c9be Sep 09 18:17:53 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:53 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0 1G" returned: 0 in 0.528s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:53 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0 Sep 09 18:17:53 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:53 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-81722dc6-647d-4cc8-bba4-4abee36fc652 tempest-ServerActionsTestOtherA-1653548153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-067421d7-c8b7-4251-ac05-67bc21a2c9be" returned: 0 in 0.281s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:53 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-81722dc6-647d-4cc8-bba4-4abee36fc652 tempest-ServerActionsTestOtherA-1653548153 None] Lock "cinder-quobyte-067421d7-c8b7-4251-ac05-67bc21a2c9be" released by "delete_volume" :: held 0.785s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:53 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-81722dc6-647d-4cc8-bba4-4abee36fc652 tempest-ServerActionsTestOtherA-1653548153 None] Created reservations ['bd3bed1a-11df-470a-b6f8-6969035d895b', '30418ee3-3de0-4827-a3f1-a84070cbe464', '77da7243-c945-49db-9edc-b006ba02e890', '514ae1f7-bbdc-4a0d-bac9-383f1da458ce'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:17:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-81722dc6-647d-4cc8-bba4-4abee36fc652 tempest-ServerActionsTestOtherA-1653548153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-81722dc6-647d-4cc8-bba4-4abee36fc652 tempest-ServerActionsTestOtherA-1653548153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-81722dc6-647d-4cc8-bba4-4abee36fc652 tempest-ServerActionsTestOtherA-1653548153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-81722dc6-647d-4cc8-bba4-4abee36fc652 tempest-ServerActionsTestOtherA-1653548153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-81722dc6-647d-4cc8-bba4-4abee36fc652 tempest-ServerActionsTestOtherA-1653548153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-81722dc6-647d-4cc8-bba4-4abee36fc652 tempest-ServerActionsTestOtherA-1653548153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:53 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:17:53 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:53 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0" returned: 0 in 0.375s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:53 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 18:17:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:53 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0 Sep 09 18:17:53 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:54 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-81722dc6-647d-4cc8-bba4-4abee36fc652 tempest-ServerActionsTestOtherA-1653548153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.309s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:54 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-81722dc6-647d-4cc8-bba4-4abee36fc652 tempest-ServerActionsTestOtherA-1653548153 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:17:54 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-81722dc6-647d-4cc8-bba4-4abee36fc652 tempest-ServerActionsTestOtherA-1653548153 None] Deleted volume successfully. Sep 09 18:17:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-1666900e-db74-40fd-bf32-b741231ed3c2 req-7d663ee9-9254-46ab-96da-fb8ad9091e43 tempest-AttachVolumeTestJSON-1359511233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:54 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-81722dc6-647d-4cc8-bba4-4abee36fc652 tempest-ServerActionsTestOtherA-1653548153 None] Lock "cinder-067421d7-c8b7-4251-ac05-67bc21a2c9be-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:17:54 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0" returned: 0 in 0.347s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:54 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.info Sep 09 18:17:54 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:54 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.info" returned: 0 in 0.329s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:54 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 18:17:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:54 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.info Sep 09 18:17:54 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:54 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.info" returned: 0 in 0.299s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:54 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Acquiring lock "cinder-quobyte-345605c5-4f72-4bdc-ab14-5256fa101d86" by "_copy_volume_from_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:17:54 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Lock "cinder-quobyte-345605c5-4f72-4bdc-ab14-5256fa101d86" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:17:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] snapshot: cba2a486-94b6-423b-9bae-5e5b459636c0, volume: 345605c5-4f72-4bdc-ab14-5256fa101d86, {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 18:17:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:17:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:17:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:17:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:17:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:17:54 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32d5cc7-9a75-4135-a7d3-2789d466c7b4]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:17:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:55 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0 Sep 09 18:17:55 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:55 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0" returned: 0 in 0.387s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:55 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:17:55 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aca09d7-7e1f-4f23-af2d-187a8a1a91f2]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:17:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:55 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a Sep 09 18:17:55 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:17:55 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Sep 09 18:17:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a" returned: 0 in 0.471s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:17:55 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 18:17:55 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Creating direct copy from snapshot {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 18:17:55 devstack cinder-volume[87639]: DEBUG cinder.utils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Path /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-345605c5-4f72-4bdc-ab14-5256fa101d86 not found in is_blk_device check {{(pid=87639) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 18:17:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-345605c5-4f72-4bdc-ab14-5256fa101d86 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:17:55 devstack sudo[95813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-345605c5-4f72-4bdc-ab14-5256fa101d86 Sep 09 18:17:55 devstack sudo[95813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:00 devstack sudo[95813]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-345605c5-4f72-4bdc-ab14-5256fa101d86" returned: 0 in 5.008s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:00 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Image conversion details: src /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a, size 1024.00 MB, duration 5.01 sec, destination /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-345605c5-4f72-4bdc-ab14-5256fa101d86 {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:18:00 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Converted 1024.00 MB image at 204.40 MB/s Sep 09 18:18:00 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-345605c5-4f72-4bdc-ab14-5256fa101d86 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 18:18:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-345605c5-4f72-4bdc-ab14-5256fa101d86 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:00 devstack sudo[95863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-345605c5-4f72-4bdc-ab14-5256fa101d86 Sep 09 18:18:00 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:01 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-345605c5-4f72-4bdc-ab14-5256fa101d86" returned: 0 in 0.279s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:01 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Lock "cinder-quobyte-345605c5-4f72-4bdc-ab14-5256fa101d86" released by "_copy_volume_from_snapshot" :: held 6.226s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:01 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Acquiring lock "cinder-quobyte-cba2a486-94b6-423b-9bae-5e5b459636c0" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:01 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Lock "cinder-quobyte-cba2a486-94b6-423b-9bae-5e5b459636c0" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Deleting offline snapshot cba2a486-94b6-423b-9bae-5e5b459636c0 of volume 6d7af1da-c2fb-4491-af4d-fe9e36ce381a {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:18:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] snapshot_file for this snap is: volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:18:01 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7de826-b797-4889-9c6e-e8aaf126c13c]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:18:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:01 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0 Sep 09 18:18:01 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:01 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0" returned: 0 in 0.377s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:18:01 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4586c8c-8a38-4168-a703-f165067d21c6]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:18:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:01 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a Sep 09 18:18:01 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:02 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a" returned: 0 in 0.566s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:02 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0 Sep 09 18:18:02 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:02 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0" returned: 0 in 0.373s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:02 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0 Sep 09 18:18:02 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:02 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a.cba2a486-94b6-423b-9bae-5e5b459636c0" returned: 0 in 0.266s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Lock "cinder-quobyte-cba2a486-94b6-423b-9bae-5e5b459636c0" released by "_delete_snapshot" :: held 1.707s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.480s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.550s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1633149187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d15a2153-6849-40e8-9db0-c08329553f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6e714d225e049f2ad71142579310374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:17:52Z,use_quota=True,user_id='be4a20e652e44c08b3779081c4b3d8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:18:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Creating volume d15a2153-6849-40e8-9db0-c08329553f9a {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:18:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:18:02 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:18:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d15a2153-6849-40e8-9db0-c08329553f9a 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:03 devstack sudo[95887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d15a2153-6849-40e8-9db0-c08329553f9a 1073741824 Sep 09 18:18:03 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:03 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-2103469f-ca1f-406e-a942-8832ab311d7d tempest-GroupsV314Test-1145777028 None] Create group from source-group-40aa4caf-44a6-4420-b9e4-b4cb42a9e3c1 completed successfully. Sep 09 18:18:03 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d15a2153-6849-40e8-9db0-c08329553f9a 1073741824" returned: 0 in 0.449s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d15a2153-6849-40e8-9db0-c08329553f9a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:03 devstack sudo[95893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d15a2153-6849-40e8-9db0-c08329553f9a Sep 09 18:18:03 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:03 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d15a2153-6849-40e8-9db0-c08329553f9a" returned: 0 in 0.305s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:18:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-1666900e-db74-40fd-bf32-b741231ed3c2 req-7d663ee9-9254-46ab-96da-fb8ad9091e43 tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.607s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22fb3c7-63da-439a-bff0-7a050a547922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d15a2153-6849-40e8-9db0-c08329553f9a', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae42a1e1-dcbf-4c07-85b8-bb992cdd71f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-1666900e-db74-40fd-bf32-b741231ed3c2 req-7d663ee9-9254-46ab-96da-fb8ad9091e43 tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:03 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Volume volume-d15a2153-6849-40e8-9db0-c08329553f9a (d15a2153-6849-40e8-9db0-c08329553f9a): created successfully Sep 09 18:18:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae42a1e1-dcbf-4c07-85b8-bb992cdd71f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Flow 'volume_create_manager' (79c80c4c-2f6a-456b-81b1-94647ba95754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:03 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-233692b2-192f-4d12-a1c6-6f5309f859a5 tempest-VolumesActionsTest-1360657215 None] Created volume successfully. Sep 09 18:18:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-1666900e-db74-40fd-bf32-b741231ed3c2 req-7d663ee9-9254-46ab-96da-fb8ad9091e43 tempest-AttachVolumeTestJSON-1359511233 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-6183f299-1344-47b7-8a3f-dd8a31d16ab6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed28f376-4bf9-4b8b-9789-568fe1029e3d', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:18:03 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-1666900e-db74-40fd-bf32-b741231ed3c2 req-7d663ee9-9254-46ab-96da-fb8ad9091e43 tempest-AttachVolumeTestJSON-1359511233 None] attachment_update completed successfully. Sep 09 18:18:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c42655dc-37e8-4aa6-b99a-ac41a532eaee tempest-GroupsV314Test-1145777028 None] Acquiring lock "cinder-quobyte-345605c5-4f72-4bdc-ab14-5256fa101d86" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c42655dc-37e8-4aa6-b99a-ac41a532eaee tempest-GroupsV314Test-1145777028 None] Lock "cinder-quobyte-345605c5-4f72-4bdc-ab14-5256fa101d86" acquired by "delete_volume" :: waited 0.037s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:04 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30c50fa-391e-48b4-b5fe-8371368c1176]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:18:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c42655dc-37e8-4aa6-b99a-ac41a532eaee tempest-GroupsV314Test-1145777028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-345605c5-4f72-4bdc-ab14-5256fa101d86 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:04 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-345605c5-4f72-4bdc-ab14-5256fa101d86 Sep 09 18:18:04 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:04 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c42655dc-37e8-4aa6-b99a-ac41a532eaee tempest-GroupsV314Test-1145777028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-345605c5-4f72-4bdc-ab14-5256fa101d86" returned: 0 in 0.422s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c42655dc-37e8-4aa6-b99a-ac41a532eaee tempest-GroupsV314Test-1145777028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-345605c5-4f72-4bdc-ab14-5256fa101d86 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:04 devstack sudo[96285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-345605c5-4f72-4bdc-ab14-5256fa101d86 Sep 09 18:18:04 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8c5be38a-a26c-448d-9b60-948dd7daaddc tempest-VolumesActionsTest-517549068 None] Acquiring lock "cinder-d15a2153-6849-40e8-9db0-c08329553f9a-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:05 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c42655dc-37e8-4aa6-b99a-ac41a532eaee tempest-GroupsV314Test-1145777028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-345605c5-4f72-4bdc-ab14-5256fa101d86" returned: 0 in 0.465s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8c5be38a-a26c-448d-9b60-948dd7daaddc tempest-VolumesActionsTest-517549068 None] Lock "cinder-d15a2153-6849-40e8-9db0-c08329553f9a-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c42655dc-37e8-4aa6-b99a-ac41a532eaee tempest-GroupsV314Test-1145777028 None] Lock "cinder-quobyte-345605c5-4f72-4bdc-ab14-5256fa101d86" released by "delete_volume" :: held 0.965s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8c5be38a-a26c-448d-9b60-948dd7daaddc tempest-VolumesActionsTest-517549068 None] Acquiring lock "cinder-quobyte-d15a2153-6849-40e8-9db0-c08329553f9a" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8c5be38a-a26c-448d-9b60-948dd7daaddc tempest-VolumesActionsTest-517549068 None] Lock "cinder-quobyte-d15a2153-6849-40e8-9db0-c08329553f9a" acquired by "delete_volume" :: waited 0.020s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:05 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de537ca-9c65-42e6-b104-8614edd4091d]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:18:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8c5be38a-a26c-448d-9b60-948dd7daaddc tempest-VolumesActionsTest-517549068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d15a2153-6849-40e8-9db0-c08329553f9a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:05 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-c42655dc-37e8-4aa6-b99a-ac41a532eaee tempest-GroupsV314Test-1145777028 None] Created reservations ['29c16a2b-24f3-4317-ba20-940c2a8b7b01'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:18:05 devstack cinder-volume[87639]: WARNING cinder.quota [None req-c42655dc-37e8-4aa6-b99a-ac41a532eaee tempest-GroupsV314Test-1145777028 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1107373836 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1107373836, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:18:05 devstack cinder-volume[87639]: WARNING cinder.quota [None req-c42655dc-37e8-4aa6-b99a-ac41a532eaee tempest-GroupsV314Test-1145777028 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1107373836 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1107373836, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:18:05 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-c42655dc-37e8-4aa6-b99a-ac41a532eaee tempest-GroupsV314Test-1145777028 None] Created reservations ['0ccb6b0b-a0b1-475e-a24a-0c3ac896703d', 'e0b25ef3-b299-481f-9d6a-b84ccff2cd23', '809b97c0-1ed0-4329-b2d4-6fe8550a6907', 'a06a76df-d5c5-443c-b840-db09c958191c'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:18:05 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d15a2153-6849-40e8-9db0-c08329553f9a Sep 09 18:18:05 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c42655dc-37e8-4aa6-b99a-ac41a532eaee tempest-GroupsV314Test-1145777028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c42655dc-37e8-4aa6-b99a-ac41a532eaee tempest-GroupsV314Test-1145777028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:05 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c42655dc-37e8-4aa6-b99a-ac41a532eaee tempest-GroupsV314Test-1145777028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:05 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c42655dc-37e8-4aa6-b99a-ac41a532eaee tempest-GroupsV314Test-1145777028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c42655dc-37e8-4aa6-b99a-ac41a532eaee tempest-GroupsV314Test-1145777028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c42655dc-37e8-4aa6-b99a-ac41a532eaee tempest-GroupsV314Test-1145777028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:05 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:18:05 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:05 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8c5be38a-a26c-448d-9b60-948dd7daaddc tempest-VolumesActionsTest-517549068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d15a2153-6849-40e8-9db0-c08329553f9a" returned: 0 in 0.451s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8c5be38a-a26c-448d-9b60-948dd7daaddc tempest-VolumesActionsTest-517549068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d15a2153-6849-40e8-9db0-c08329553f9a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:05 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c42655dc-37e8-4aa6-b99a-ac41a532eaee tempest-GroupsV314Test-1145777028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.279s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:05 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-c42655dc-37e8-4aa6-b99a-ac41a532eaee tempest-GroupsV314Test-1145777028 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:18:05 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d15a2153-6849-40e8-9db0-c08329553f9a Sep 09 18:18:05 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:05 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-c42655dc-37e8-4aa6-b99a-ac41a532eaee tempest-GroupsV314Test-1145777028 None] Delete group completed successfully. Sep 09 18:18:05 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8c5be38a-a26c-448d-9b60-948dd7daaddc tempest-VolumesActionsTest-517549068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d15a2153-6849-40e8-9db0-c08329553f9a" returned: 0 in 0.299s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8c5be38a-a26c-448d-9b60-948dd7daaddc tempest-VolumesActionsTest-517549068 None] Lock "cinder-quobyte-d15a2153-6849-40e8-9db0-c08329553f9a" released by "delete_volume" :: held 0.804s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:05 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-8c5be38a-a26c-448d-9b60-948dd7daaddc tempest-VolumesActionsTest-517549068 None] Created reservations ['6526bf20-3e5c-41bb-80d4-2771d4f9d21b', 'fb770aef-6ecb-43e1-a256-9f99db5fa31b', '800928ff-c8b4-48e5-bb5c-8f17b055aab5', 'a3db86f9-19c6-4c5d-836f-3a4c1e43581a'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:18:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8c5be38a-a26c-448d-9b60-948dd7daaddc tempest-VolumesActionsTest-517549068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8c5be38a-a26c-448d-9b60-948dd7daaddc tempest-VolumesActionsTest-517549068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8c5be38a-a26c-448d-9b60-948dd7daaddc tempest-VolumesActionsTest-517549068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8c5be38a-a26c-448d-9b60-948dd7daaddc tempest-VolumesActionsTest-517549068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8c5be38a-a26c-448d-9b60-948dd7daaddc tempest-VolumesActionsTest-517549068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8c5be38a-a26c-448d-9b60-948dd7daaddc tempest-VolumesActionsTest-517549068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:06 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:18:06 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:06 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8c5be38a-a26c-448d-9b60-948dd7daaddc tempest-VolumesActionsTest-517549068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.361s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:06 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-8c5be38a-a26c-448d-9b60-948dd7daaddc tempest-VolumesActionsTest-517549068 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:18:06 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-8c5be38a-a26c-448d-9b60-948dd7daaddc tempest-VolumesActionsTest-517549068 None] Deleted volume successfully. Sep 09 18:18:06 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8c5be38a-a26c-448d-9b60-948dd7daaddc tempest-VolumesActionsTest-517549068 None] Lock "cinder-d15a2153-6849-40e8-9db0-c08329553f9a-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:06 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c447680d-6772-4c8d-8b2b-05998a7932ce tempest-GroupsV314Test-1145777028 None] Acquiring lock "cinder-quobyte-6d7af1da-c2fb-4491-af4d-fe9e36ce381a" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:06 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c447680d-6772-4c8d-8b2b-05998a7932ce tempest-GroupsV314Test-1145777028 None] Lock "cinder-quobyte-6d7af1da-c2fb-4491-af4d-fe9e36ce381a" acquired by "delete_volume" :: waited 0.020s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:06 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de43f97-f8ac-429c-a504-dce0b8d293a6]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:18:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c447680d-6772-4c8d-8b2b-05998a7932ce tempest-GroupsV314Test-1145777028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:06 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a Sep 09 18:18:06 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Flow 'volume_create_manager' (40cb0cf1-aaee-44ca-8a6b-639ebf4832c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b6d005-9a08-4021-b745-3d07230a660b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b6d005-9a08-4021-b745-3d07230a660b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1943087656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f299542-30bc-461a-b9f3-c5ed98233de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6e714d225e049f2ad71142579310374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:18:07Z,use_quota=True,user_id='be4a20e652e44c08b3779081c4b3d8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d967ebf-e6fb-4f0b-b6de-cec1441777f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d967ebf-e6fb-4f0b-b6de-cec1441777f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09584aa1-34d8-4d69-bb1f-f1f46b751a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09584aa1-34d8-4d69-bb1f-f1f46b751a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f299542-30bc-461a-b9f3-c5ed98233de0', 'volume_name': 'volume-6f299542-30bc-461a-b9f3-c5ed98233de0', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb50803-f850-42ad-b867-2835ccbf2571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb50803-f850-42ad-b867-2835ccbf2571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2825e2-5eaf-4a09-81f1-22f6fca80df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:07 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Volume 6f299542-30bc-461a-b9f3-c5ed98233de0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f299542-30bc-461a-b9f3-c5ed98233de0', 'volume_size': 1} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1943087656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f299542-30bc-461a-b9f3-c5ed98233de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6e714d225e049f2ad71142579310374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:18:07Z,use_quota=True,user_id='be4a20e652e44c08b3779081c4b3d8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Creating volume 6f299542-30bc-461a-b9f3-c5ed98233de0 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:18:07 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6f299542-30bc-461a-b9f3-c5ed98233de0 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:07 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6f299542-30bc-461a-b9f3-c5ed98233de0 1073741824 Sep 09 18:18:07 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:07 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c447680d-6772-4c8d-8b2b-05998a7932ce tempest-GroupsV314Test-1145777028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a" returned: 0 in 0.494s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c447680d-6772-4c8d-8b2b-05998a7932ce tempest-GroupsV314Test-1145777028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:07 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a Sep 09 18:18:07 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:07 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c447680d-6772-4c8d-8b2b-05998a7932ce tempest-GroupsV314Test-1145777028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6d7af1da-c2fb-4491-af4d-fe9e36ce381a" returned: 0 in 0.296s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c447680d-6772-4c8d-8b2b-05998a7932ce tempest-GroupsV314Test-1145777028 None] Lock "cinder-quobyte-6d7af1da-c2fb-4491-af4d-fe9e36ce381a" released by "delete_volume" :: held 0.893s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:07 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6f299542-30bc-461a-b9f3-c5ed98233de0 1073741824" returned: 0 in 0.492s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6f299542-30bc-461a-b9f3-c5ed98233de0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-c447680d-6772-4c8d-8b2b-05998a7932ce tempest-GroupsV314Test-1145777028 None] Created reservations ['dde9bbe9-9d2c-48a0-abc9-70a88bd15952'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:18:07 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6f299542-30bc-461a-b9f3-c5ed98233de0 Sep 09 18:18:07 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-c447680d-6772-4c8d-8b2b-05998a7932ce tempest-GroupsV314Test-1145777028 None] Created reservations ['0b0a5c02-201b-4f07-b54a-efc44c934cdc', '8708a2a5-4159-4153-b74c-93cfb9ae3e01', 'fef386a5-531d-43cc-b639-9d7f371c6b1d', 'fa674e51-9404-4303-8dc9-217e607be225'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c447680d-6772-4c8d-8b2b-05998a7932ce tempest-GroupsV314Test-1145777028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c447680d-6772-4c8d-8b2b-05998a7932ce tempest-GroupsV314Test-1145777028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c447680d-6772-4c8d-8b2b-05998a7932ce tempest-GroupsV314Test-1145777028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c447680d-6772-4c8d-8b2b-05998a7932ce tempest-GroupsV314Test-1145777028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c447680d-6772-4c8d-8b2b-05998a7932ce tempest-GroupsV314Test-1145777028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c447680d-6772-4c8d-8b2b-05998a7932ce tempest-GroupsV314Test-1145777028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:07 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:18:07 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:08 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6f299542-30bc-461a-b9f3-c5ed98233de0" returned: 0 in 0.412s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:18:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2825e2-5eaf-4a09-81f1-22f6fca80df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f299542-30bc-461a-b9f3-c5ed98233de0', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c200a9-4963-4ff6-b028-5c42758096ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:08 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Volume volume-6f299542-30bc-461a-b9f3-c5ed98233de0 (6f299542-30bc-461a-b9f3-c5ed98233de0): created successfully Sep 09 18:18:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19c200a9-4963-4ff6-b028-5c42758096ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Flow 'volume_create_manager' (40cb0cf1-aaee-44ca-8a6b-639ebf4832c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:08 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-b6c483ad-eed0-4f47-80b2-5b4ee8283cd1 tempest-VolumesActionsTest-1360657215 None] Created volume successfully. Sep 09 18:18:08 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c447680d-6772-4c8d-8b2b-05998a7932ce tempest-GroupsV314Test-1145777028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.442s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:08 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-c447680d-6772-4c8d-8b2b-05998a7932ce tempest-GroupsV314Test-1145777028 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:18:08 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-c447680d-6772-4c8d-8b2b-05998a7932ce tempest-GroupsV314Test-1145777028 None] Delete group completed successfully. Sep 09 18:18:10 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5c4ff23f-576d-43ca-9345-d730eddd8d16 tempest-VolumesActionsTest-1360657215 None] Acquiring lock "cinder-6f299542-30bc-461a-b9f3-c5ed98233de0-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:10 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5c4ff23f-576d-43ca-9345-d730eddd8d16 tempest-VolumesActionsTest-1360657215 None] Lock "cinder-6f299542-30bc-461a-b9f3-c5ed98233de0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:10 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5c4ff23f-576d-43ca-9345-d730eddd8d16 tempest-VolumesActionsTest-1360657215 None] Acquiring lock "cinder-quobyte-6f299542-30bc-461a-b9f3-c5ed98233de0" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:10 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5c4ff23f-576d-43ca-9345-d730eddd8d16 tempest-VolumesActionsTest-1360657215 None] Lock "cinder-quobyte-6f299542-30bc-461a-b9f3-c5ed98233de0" acquired by "delete_volume" :: waited 0.054s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:10 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfad5cd1-eb17-4ba8-ae24-9776fa6238a4]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:18:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5c4ff23f-576d-43ca-9345-d730eddd8d16 tempest-VolumesActionsTest-1360657215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6f299542-30bc-461a-b9f3-c5ed98233de0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:11 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6f299542-30bc-461a-b9f3-c5ed98233de0 Sep 09 18:18:11 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:11 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5c4ff23f-576d-43ca-9345-d730eddd8d16 tempest-VolumesActionsTest-1360657215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6f299542-30bc-461a-b9f3-c5ed98233de0" returned: 0 in 0.680s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5c4ff23f-576d-43ca-9345-d730eddd8d16 tempest-VolumesActionsTest-1360657215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6f299542-30bc-461a-b9f3-c5ed98233de0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:11 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6f299542-30bc-461a-b9f3-c5ed98233de0 Sep 09 18:18:11 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:12 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5c4ff23f-576d-43ca-9345-d730eddd8d16 tempest-VolumesActionsTest-1360657215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6f299542-30bc-461a-b9f3-c5ed98233de0" returned: 0 in 0.637s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5c4ff23f-576d-43ca-9345-d730eddd8d16 tempest-VolumesActionsTest-1360657215 None] Lock "cinder-quobyte-6f299542-30bc-461a-b9f3-c5ed98233de0" released by "delete_volume" :: held 1.426s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:12 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-5c4ff23f-576d-43ca-9345-d730eddd8d16 tempest-VolumesActionsTest-1360657215 None] Created reservations ['6da1d13a-3232-44c4-ba96-c2a623f77b64', 'bd1662fc-f03e-4177-81f6-6929df9b6127', '15811249-3f3e-45cc-ad87-592682c7f55d', 'df04e6d7-2035-4827-bedb-9c7cacd98af1'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:18:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5c4ff23f-576d-43ca-9345-d730eddd8d16 tempest-VolumesActionsTest-1360657215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5c4ff23f-576d-43ca-9345-d730eddd8d16 tempest-VolumesActionsTest-1360657215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5c4ff23f-576d-43ca-9345-d730eddd8d16 tempest-VolumesActionsTest-1360657215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5c4ff23f-576d-43ca-9345-d730eddd8d16 tempest-VolumesActionsTest-1360657215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5c4ff23f-576d-43ca-9345-d730eddd8d16 tempest-VolumesActionsTest-1360657215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5c4ff23f-576d-43ca-9345-d730eddd8d16 tempest-VolumesActionsTest-1360657215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:12 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:18:12 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:12 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5c4ff23f-576d-43ca-9345-d730eddd8d16 tempest-VolumesActionsTest-1360657215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.444s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:12 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-5c4ff23f-576d-43ca-9345-d730eddd8d16 tempest-VolumesActionsTest-1360657215 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:18:13 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-5c4ff23f-576d-43ca-9345-d730eddd8d16 tempest-VolumesActionsTest-1360657215 None] Deleted volume successfully. Sep 09 18:18:13 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5c4ff23f-576d-43ca-9345-d730eddd8d16 tempest-VolumesActionsTest-1360657215 None] Lock "cinder-6f299542-30bc-461a-b9f3-c5ed98233de0-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:13 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-5326fbc0-4205-43c4-9992-cda4c1118ce5 tempest-GroupsTest-996345343 None] Group tempest-Group1-644570108: creating Sep 09 18:18:13 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-5326fbc0-4205-43c4-9992-cda4c1118ce5 tempest-GroupsTest-996345343 None] Group tempest-Group1-644570108: created successfully Sep 09 18:18:13 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-5326fbc0-4205-43c4-9992-cda4c1118ce5 tempest-GroupsTest-996345343 None] Create group completed successfully. Sep 09 18:18:14 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ba828333-cba8-4a03-a959-0674a20d8a6e tempest-GroupsTest-996345343 None] Group tempest-Group2-1727289019: creating Sep 09 18:18:14 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ba828333-cba8-4a03-a959-0674a20d8a6e tempest-GroupsTest-996345343 None] Group tempest-Group2-1727289019: created successfully Sep 09 18:18:14 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ba828333-cba8-4a03-a959-0674a20d8a6e tempest-GroupsTest-996345343 None] Create group completed successfully. Sep 09 18:18:16 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:18:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Flow 'volume_create_manager' (85294788-ebb4-4719-b2f2-41aac4222f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5353075-d33a-4a45-9875-3ecc6832b196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5353075-d33a-4a45-9875-3ecc6832b196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1937507631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a24bb292-6a5b-429e-a45b-26b60fd0af49,host='devstack@QuobyteHD#QuobyteHD',id=9035ba9b-b1a9-4588-bf01-4977c28889f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='746bb01875de4c46876db248e7f818b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:18:16Z,use_quota=True,user_id='83378c265b944b5992ca946667f2d711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0288aa4-3a51-45cf-bd67-96f78bfa907d),volume_type_id=c0288aa4-3a51-45cf-bd67-96f78bfa907d)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e89861-2f8c-41fa-91d1-32ab605a70e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e89861-2f8c-41fa-91d1-32ab605a70e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c0ebab-d632-4542-b8f3-b4d7b053f666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c0ebab-d632-4542-b8f3-b4d7b053f666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9035ba9b-b1a9-4588-bf01-4977c28889f1', 'volume_name': 'volume-9035ba9b-b1a9-4588-bf01-4977c28889f1', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60f3bc1-34f9-4a1d-93db-77dd48f7d45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60f3bc1-34f9-4a1d-93db-77dd48f7d45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d63c6a2-87d8-49f5-8e68-7587fb9f5d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:16 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Volume 9035ba9b-b1a9-4588-bf01-4977c28889f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9035ba9b-b1a9-4588-bf01-4977c28889f1', 'volume_size': 1} Sep 09 18:18:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a24bb292-6a5b-429e-a45b-26b60fd0af49,created_at=2026-09-09T16:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1937507631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a24bb292-6a5b-429e-a45b-26b60fd0af49,host='devstack@QuobyteHD#QuobyteHD',id=9035ba9b-b1a9-4588-bf01-4977c28889f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='746bb01875de4c46876db248e7f818b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:18:16Z,use_quota=True,user_id='83378c265b944b5992ca946667f2d711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0288aa4-3a51-45cf-bd67-96f78bfa907d),volume_type_id=c0288aa4-3a51-45cf-bd67-96f78bfa907d)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:18:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Creating volume 9035ba9b-b1a9-4588-bf01-4977c28889f1 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:18:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:18:16 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:18:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9035ba9b-b1a9-4588-bf01-4977c28889f1 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:16 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9035ba9b-b1a9-4588-bf01-4977c28889f1 1073741824 Sep 09 18:18:16 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:17 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9035ba9b-b1a9-4588-bf01-4977c28889f1 1073741824" returned: 0 in 0.776s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9035ba9b-b1a9-4588-bf01-4977c28889f1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:17 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9035ba9b-b1a9-4588-bf01-4977c28889f1 Sep 09 18:18:17 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:17 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9035ba9b-b1a9-4588-bf01-4977c28889f1" returned: 0 in 0.330s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:18:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d63c6a2-87d8-49f5-8e68-7587fb9f5d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9035ba9b-b1a9-4588-bf01-4977c28889f1', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebff8e75-4027-4733-b56b-94b0cf5d9cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:17 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Volume volume-9035ba9b-b1a9-4588-bf01-4977c28889f1 (9035ba9b-b1a9-4588-bf01-4977c28889f1): created successfully Sep 09 18:18:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebff8e75-4027-4733-b56b-94b0cf5d9cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Flow 'volume_create_manager' (85294788-ebb4-4719-b2f2-41aac4222f03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:17 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-4c9779c2-3d8d-42e4-8c2b-e71b845103e6 tempest-GroupsTest-996345343 None] Created volume successfully. Sep 09 18:18:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1eb9e698-cf9b-4ab9-9d47-043cb3067c9e tempest-GroupsTest-996345343 None] Acquiring lock "cinder-quobyte-9035ba9b-b1a9-4588-bf01-4977c28889f1" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1eb9e698-cf9b-4ab9-9d47-043cb3067c9e tempest-GroupsTest-996345343 None] Lock "cinder-quobyte-9035ba9b-b1a9-4588-bf01-4977c28889f1" acquired by "delete_volume" :: waited 0.029s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:19 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7edb790-0a72-44f5-86a2-eba4a150d04e]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:18:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1eb9e698-cf9b-4ab9-9d47-043cb3067c9e tempest-GroupsTest-996345343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9035ba9b-b1a9-4588-bf01-4977c28889f1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:20 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9035ba9b-b1a9-4588-bf01-4977c28889f1 Sep 09 18:18:20 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:20 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1eb9e698-cf9b-4ab9-9d47-043cb3067c9e tempest-GroupsTest-996345343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9035ba9b-b1a9-4588-bf01-4977c28889f1" returned: 0 in 0.554s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1eb9e698-cf9b-4ab9-9d47-043cb3067c9e tempest-GroupsTest-996345343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9035ba9b-b1a9-4588-bf01-4977c28889f1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:20 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9035ba9b-b1a9-4588-bf01-4977c28889f1 Sep 09 18:18:20 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:20 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1eb9e698-cf9b-4ab9-9d47-043cb3067c9e tempest-GroupsTest-996345343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9035ba9b-b1a9-4588-bf01-4977c28889f1" returned: 0 in 0.356s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:20 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1eb9e698-cf9b-4ab9-9d47-043cb3067c9e tempest-GroupsTest-996345343 None] Lock "cinder-quobyte-9035ba9b-b1a9-4588-bf01-4977c28889f1" released by "delete_volume" :: held 0.984s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:21 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-1eb9e698-cf9b-4ab9-9d47-043cb3067c9e tempest-GroupsTest-996345343 None] Created reservations ['5928c2bf-4314-42c0-bbf3-31a6c7bfbd6b'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:18:21 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:UPDATE=157,cinder:SELECT=118,cinder:INSERT=37,cinder:DELETE=13 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:18:21 devstack cinder-volume[87639]: WARNING cinder.quota [None req-1eb9e698-cf9b-4ab9-9d47-043cb3067c9e tempest-GroupsTest-996345343 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1304750626 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1304750626, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:18:21 devstack cinder-volume[87639]: WARNING cinder.quota [None req-1eb9e698-cf9b-4ab9-9d47-043cb3067c9e tempest-GroupsTest-996345343 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1304750626 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1304750626, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:18:21 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-1eb9e698-cf9b-4ab9-9d47-043cb3067c9e tempest-GroupsTest-996345343 None] Created reservations ['070fe9b2-17fd-45aa-9dd7-17475358f2df', '2c77b619-f4a6-4be6-ac9f-753d5f69df89', '40262e42-0627-48d1-8440-4b0446b36287', '3a0772ad-c569-44d5-b784-dcea64bdc513'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:18:21 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=138,cinder:UPDATE=161,cinder:DELETE=10,cinder:INSERT=35 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:18:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1eb9e698-cf9b-4ab9-9d47-043cb3067c9e tempest-GroupsTest-996345343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1eb9e698-cf9b-4ab9-9d47-043cb3067c9e tempest-GroupsTest-996345343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1eb9e698-cf9b-4ab9-9d47-043cb3067c9e tempest-GroupsTest-996345343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1eb9e698-cf9b-4ab9-9d47-043cb3067c9e tempest-GroupsTest-996345343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1eb9e698-cf9b-4ab9-9d47-043cb3067c9e tempest-GroupsTest-996345343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1eb9e698-cf9b-4ab9-9d47-043cb3067c9e tempest-GroupsTest-996345343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:21 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:18:21 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:21 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1eb9e698-cf9b-4ab9-9d47-043cb3067c9e tempest-GroupsTest-996345343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.390s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:21 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-1eb9e698-cf9b-4ab9-9d47-043cb3067c9e tempest-GroupsTest-996345343 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:18:21 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-1eb9e698-cf9b-4ab9-9d47-043cb3067c9e tempest-GroupsTest-996345343 None] Delete group completed successfully. Sep 09 18:18:22 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-86b823dd-ca75-4483-ab54-b9de9091fdbb tempest-GroupsTest-996345343 None] Created reservations ['f1a2e720-573e-43f9-ac25-d5a2b7d33dd7'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:18:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-86b823dd-ca75-4483-ab54-b9de9091fdbb tempest-GroupsTest-996345343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-86b823dd-ca75-4483-ab54-b9de9091fdbb tempest-GroupsTest-996345343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-86b823dd-ca75-4483-ab54-b9de9091fdbb tempest-GroupsTest-996345343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-86b823dd-ca75-4483-ab54-b9de9091fdbb tempest-GroupsTest-996345343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-86b823dd-ca75-4483-ab54-b9de9091fdbb tempest-GroupsTest-996345343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-86b823dd-ca75-4483-ab54-b9de9091fdbb tempest-GroupsTest-996345343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:22 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:18:22 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:23 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-86b823dd-ca75-4483-ab54-b9de9091fdbb tempest-GroupsTest-996345343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.371s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:23 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-86b823dd-ca75-4483-ab54-b9de9091fdbb tempest-GroupsTest-996345343 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:18:23 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-86b823dd-ca75-4483-ab54-b9de9091fdbb tempest-GroupsTest-996345343 None] Delete group completed successfully. Sep 09 18:18:24 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ff637581-59f6-4f66-964e-1c738eefed05 tempest-GroupsTest-996345343 None] Group tempest-GroupsTest-Group-358742158: creating Sep 09 18:18:24 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ff637581-59f6-4f66-964e-1c738eefed05 tempest-GroupsTest-996345343 None] Group tempest-GroupsTest-Group-358742158: created successfully Sep 09 18:18:24 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ff637581-59f6-4f66-964e-1c738eefed05 tempest-GroupsTest-996345343 None] Create group completed successfully. Sep 09 18:18:26 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:18:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Flow 'volume_create_manager' (05d9c3d8-7730-401f-9a28-e527f38c3c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31b3960-8944-4613-ad0f-69ae5669b0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b31b3960-8944-4613-ad0f-69ae5669b0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1765158934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73495824-35b3-4b5d-84e1-4704b7b7a726,host='devstack@QuobyteHD#QuobyteHD',id=572df56a-2d88-4fba-9c81-3035c7730322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='746bb01875de4c46876db248e7f818b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:18:26Z,use_quota=True,user_id='83378c265b944b5992ca946667f2d711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58fd9215-bb18-42fc-909a-fcf9247d7489),volume_type_id=58fd9215-bb18-42fc-909a-fcf9247d7489)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d1decb-43c7-4720-8ad2-03a2b727fb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d1decb-43c7-4720-8ad2-03a2b727fb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9e2f460-1b13-410f-85a7-a30f6e5cd28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9e2f460-1b13-410f-85a7-a30f6e5cd28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '572df56a-2d88-4fba-9c81-3035c7730322', 'volume_name': 'volume-572df56a-2d88-4fba-9c81-3035c7730322', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02eab459-391b-4c7a-bd0c-5849e39d9065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02eab459-391b-4c7a-bd0c-5849e39d9065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beda4789-e27a-4e2c-889d-657e4ff57056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:26 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Volume 572df56a-2d88-4fba-9c81-3035c7730322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-572df56a-2d88-4fba-9c81-3035c7730322', 'volume_size': 1} Sep 09 18:18:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=73495824-35b3-4b5d-84e1-4704b7b7a726,created_at=2026-09-09T16:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1765158934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73495824-35b3-4b5d-84e1-4704b7b7a726,host='devstack@QuobyteHD#QuobyteHD',id=572df56a-2d88-4fba-9c81-3035c7730322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='746bb01875de4c46876db248e7f818b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:18:26Z,use_quota=True,user_id='83378c265b944b5992ca946667f2d711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58fd9215-bb18-42fc-909a-fcf9247d7489),volume_type_id=58fd9215-bb18-42fc-909a-fcf9247d7489)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:18:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Creating volume 572df56a-2d88-4fba-9c81-3035c7730322 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:18:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:18:26 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:18:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-572df56a-2d88-4fba-9c81-3035c7730322 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:26 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-572df56a-2d88-4fba-9c81-3035c7730322 1073741824 Sep 09 18:18:26 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:27 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-572df56a-2d88-4fba-9c81-3035c7730322 1073741824" returned: 0 in 0.554s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-572df56a-2d88-4fba-9c81-3035c7730322 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:27 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-572df56a-2d88-4fba-9c81-3035c7730322 Sep 09 18:18:27 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:27 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-572df56a-2d88-4fba-9c81-3035c7730322" returned: 0 in 0.283s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:27 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:18:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beda4789-e27a-4e2c-889d-657e4ff57056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-572df56a-2d88-4fba-9c81-3035c7730322', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179e8cdc-addf-4072-bcd2-13645b097142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:27 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Volume volume-572df56a-2d88-4fba-9c81-3035c7730322 (572df56a-2d88-4fba-9c81-3035c7730322): created successfully Sep 09 18:18:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179e8cdc-addf-4072-bcd2-13645b097142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Flow 'volume_create_manager' (05d9c3d8-7730-401f-9a28-e527f38c3c0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:27 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-1ed926d1-2008-4f0a-90d9-a64f660508c7 tempest-GroupsTest-996345343 None] Created volume successfully. Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Flow 'volume_create_manager' (a06f677d-97ff-41cc-a344-bb7e38b378bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a035f4-200f-4d80-a678-04ff2b9084d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a035f4-200f-4d80-a678-04ff2b9084d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1382778552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73495824-35b3-4b5d-84e1-4704b7b7a726,host='devstack@QuobyteHD#QuobyteHD',id=9af25dda-9420-4347-aed9-964fe438e6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='746bb01875de4c46876db248e7f818b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:18:28Z,use_quota=True,user_id='83378c265b944b5992ca946667f2d711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58fd9215-bb18-42fc-909a-fcf9247d7489),volume_type_id=58fd9215-bb18-42fc-909a-fcf9247d7489)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6cada0f-ddb8-4a9b-b2a9-09618ee12781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6cada0f-ddb8-4a9b-b2a9-09618ee12781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c47755-22b0-4143-8164-3ffb739e1120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c47755-22b0-4143-8164-3ffb739e1120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9af25dda-9420-4347-aed9-964fe438e6ea', 'volume_name': 'volume-9af25dda-9420-4347-aed9-964fe438e6ea', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14adf494-4e42-4604-a393-f84fb67d05bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14adf494-4e42-4604-a393-f84fb67d05bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb596adc-5f3c-4062-8edb-430b346d4816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:28 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Volume 9af25dda-9420-4347-aed9-964fe438e6ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9af25dda-9420-4347-aed9-964fe438e6ea', 'volume_size': 1} Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=73495824-35b3-4b5d-84e1-4704b7b7a726,created_at=2026-09-09T16:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1382778552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73495824-35b3-4b5d-84e1-4704b7b7a726,host='devstack@QuobyteHD#QuobyteHD',id=9af25dda-9420-4347-aed9-964fe438e6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='746bb01875de4c46876db248e7f818b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:18:28Z,use_quota=True,user_id='83378c265b944b5992ca946667f2d711',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58fd9215-bb18-42fc-909a-fcf9247d7489),volume_type_id=58fd9215-bb18-42fc-909a-fcf9247d7489)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Creating volume 9af25dda-9420-4347-aed9-964fe438e6ea {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:18:28 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9af25dda-9420-4347-aed9-964fe438e6ea 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:28 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9af25dda-9420-4347-aed9-964fe438e6ea 1073741824 Sep 09 18:18:28 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:28 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9af25dda-9420-4347-aed9-964fe438e6ea 1073741824" returned: 0 in 0.504s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9af25dda-9420-4347-aed9-964fe438e6ea {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:29 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9af25dda-9420-4347-aed9-964fe438e6ea Sep 09 18:18:29 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:29 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9af25dda-9420-4347-aed9-964fe438e6ea" returned: 0 in 0.288s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:18:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb596adc-5f3c-4062-8edb-430b346d4816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9af25dda-9420-4347-aed9-964fe438e6ea', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75d2bd6-da09-4120-975f-93ba473c8576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:29 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Volume volume-9af25dda-9420-4347-aed9-964fe438e6ea (9af25dda-9420-4347-aed9-964fe438e6ea): created successfully Sep 09 18:18:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75d2bd6-da09-4120-975f-93ba473c8576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Flow 'volume_create_manager' (a06f677d-97ff-41cc-a344-bb7e38b378bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:29 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-cde3249b-6af2-4cf7-8bed-7e1f414b9928 tempest-GroupsTest-996345343 None] Created volume successfully. Sep 09 18:18:29 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-4f439283-742b-42f8-a70c-7b16ec19f068 tempest-GroupsTest-996345343 None] Update group completed successfully. Sep 09 18:18:31 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-16a58961-54e5-481a-b9bc-f5c47207d86e tempest-GroupsTest-996345343 None] Update group completed successfully. Sep 09 18:18:31 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:18:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Flow 'volume_create_manager' (3e1d0f64-6d41-4e9c-964a-15a3cfc60318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af44d3c-4211-4497-871b-2facc95369d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af44d3c-4211-4497-871b-2facc95369d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1954571328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d028136-7034-4a4e-bd8d-15b42511ecd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfab72c16e74a439b5a676ee5e733c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:18:32Z,use_quota=True,user_id='184e113e4d0b496f85514fceaa78eb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e480cdac-8be2-414b-b145-59337d53653f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e480cdac-8be2-414b-b145-59337d53653f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4831be14-e54a-4551-b05c-be15ec26f5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4831be14-e54a-4551-b05c-be15ec26f5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d028136-7034-4a4e-bd8d-15b42511ecd4', 'volume_name': 'volume-4d028136-7034-4a4e-bd8d-15b42511ecd4', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91b33e3-9cee-48d8-90fd-88bf08b89a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91b33e3-9cee-48d8-90fd-88bf08b89a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352ff634-0932-4e55-a4dd-940a7176b36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:32 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Volume 4d028136-7034-4a4e-bd8d-15b42511ecd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d028136-7034-4a4e-bd8d-15b42511ecd4', 'volume_size': 1} Sep 09 18:18:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1954571328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d028136-7034-4a4e-bd8d-15b42511ecd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfab72c16e74a439b5a676ee5e733c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:18:32Z,use_quota=True,user_id='184e113e4d0b496f85514fceaa78eb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:18:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Creating volume 4d028136-7034-4a4e-bd8d-15b42511ecd4 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:18:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:18:32 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:18:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d028136-7034-4a4e-bd8d-15b42511ecd4 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:32 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d028136-7034-4a4e-bd8d-15b42511ecd4 1073741824 Sep 09 18:18:32 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:32 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d028136-7034-4a4e-bd8d-15b42511ecd4 1073741824" returned: 0 in 0.575s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d028136-7034-4a4e-bd8d-15b42511ecd4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:32 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d028136-7034-4a4e-bd8d-15b42511ecd4 Sep 09 18:18:32 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Acquiring lock "cinder-quobyte-572df56a-2d88-4fba-9c81-3035c7730322" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Lock "cinder-quobyte-572df56a-2d88-4fba-9c81-3035c7730322" acquired by "delete_volume" :: waited 0.033s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41d0c43-cb1f-4ec7-b860-c024fd0edcc3]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-572df56a-2d88-4fba-9c81-3035c7730322 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:33 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d028136-7034-4a4e-bd8d-15b42511ecd4" returned: 0 in 0.394s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (352ff634-0932-4e55-a4dd-940a7176b36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d028136-7034-4a4e-bd8d-15b42511ecd4', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f2cb93-96ef-4c6e-85be-4cfe1b0bdb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:33 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Volume volume-4d028136-7034-4a4e-bd8d-15b42511ecd4 (4d028136-7034-4a4e-bd8d-15b42511ecd4): created successfully Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f2cb93-96ef-4c6e-85be-4cfe1b0bdb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Flow 'volume_create_manager' (3e1d0f64-6d41-4e9c-964a-15a3cfc60318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:33 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-137cbda5-82c5-4d37-825f-60da593a7729 tempest-VolumesTransfersTest-1875607132 None] Created volume successfully. Sep 09 18:18:33 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-572df56a-2d88-4fba-9c81-3035c7730322 Sep 09 18:18:33 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:33 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-572df56a-2d88-4fba-9c81-3035c7730322" returned: 0 in 0.384s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-572df56a-2d88-4fba-9c81-3035c7730322 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:33 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-572df56a-2d88-4fba-9c81-3035c7730322 Sep 09 18:18:33 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:33 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-572df56a-2d88-4fba-9c81-3035c7730322" returned: 0 in 0.257s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Lock "cinder-quobyte-572df56a-2d88-4fba-9c81-3035c7730322" released by "delete_volume" :: held 0.697s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Acquiring lock "cinder-quobyte-9af25dda-9420-4347-aed9-964fe438e6ea" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Lock "cinder-quobyte-9af25dda-9420-4347-aed9-964fe438e6ea" acquired by "delete_volume" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[918a5046-b73e-4556-ab7a-e5548fcd2e11]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9af25dda-9420-4347-aed9-964fe438e6ea {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:18:33 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9af25dda-9420-4347-aed9-964fe438e6ea Sep 09 18:18:33 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Flow 'volume_create_manager' (35629a1f-7fd9-40b8-98e0-666eb46fa956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910826b3-fbd5-41a4-b56b-393f3806a626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910826b3-fbd5-41a4-b56b-393f3806a626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-15153016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03743e0c-fe85-476f-8fbd-0131f23acf2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b68b1c5c6d34cee9905bc1217aea9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:18:34Z,use_quota=True,user_id='9b7b8f1d4f4d47709652431abf292456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe8010b-fda0-436a-bb14-1840cf25b160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe8010b-fda0-436a-bb14-1840cf25b160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f03737b-8bd7-4448-b263-0fb81c54fc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f03737b-8bd7-4448-b263-0fb81c54fc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03743e0c-fe85-476f-8fbd-0131f23acf2a', 'volume_name': 'volume-03743e0c-fe85-476f-8fbd-0131f23acf2a', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52e2690-62c7-475a-a692-787095710baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52e2690-62c7-475a-a692-787095710baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe836b8c-f4f9-48c9-a68c-0549cda3822f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:33 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Volume 03743e0c-fe85-476f-8fbd-0131f23acf2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03743e0c-fe85-476f-8fbd-0131f23acf2a', 'volume_size': 1} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-15153016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03743e0c-fe85-476f-8fbd-0131f23acf2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b68b1c5c6d34cee9905bc1217aea9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:18:34Z,use_quota=True,user_id='9b7b8f1d4f4d47709652431abf292456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Creating volume 03743e0c-fe85-476f-8fbd-0131f23acf2a {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:18:33 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:18:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03743e0c-fe85-476f-8fbd-0131f23acf2a 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:34 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03743e0c-fe85-476f-8fbd-0131f23acf2a 1073741824 Sep 09 18:18:34 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:34 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9af25dda-9420-4347-aed9-964fe438e6ea" returned: 0 in 0.386s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9af25dda-9420-4347-aed9-964fe438e6ea {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:34 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9af25dda-9420-4347-aed9-964fe438e6ea Sep 09 18:18:34 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:34 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9af25dda-9420-4347-aed9-964fe438e6ea" returned: 0 in 0.308s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Lock "cinder-quobyte-9af25dda-9420-4347-aed9-964fe438e6ea" released by "delete_volume" :: held 0.740s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:34 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03743e0c-fe85-476f-8fbd-0131f23acf2a 1073741824" returned: 0 in 0.531s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03743e0c-fe85-476f-8fbd-0131f23acf2a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:34 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03743e0c-fe85-476f-8fbd-0131f23acf2a Sep 09 18:18:34 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:34 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Created reservations ['14b6e5a8-fddc-4cd0-a0b9-c9189ba58b41'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:18:34 devstack cinder-volume[87639]: WARNING cinder.quota [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1697476838 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1697476838, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:18:34 devstack cinder-volume[87639]: WARNING cinder.quota [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1697476838 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1697476838, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:18:34 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Created reservations ['816b941d-f673-4b14-8a5a-1affeebdc9a8', '3f682e19-ade6-4a5d-8108-991df6151513', '8db9fbc2-f83c-4d04-91f7-863fdba84640', '0b9fa014-794f-4f38-9cd8-3895a70a0664'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:18:34 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Created reservations ['cc614bae-e90b-4a0c-a4a0-edfaf75d5b1e', 'f99a89ce-8122-4243-b270-9b39fd747a05', 'c84f4ef9-6954-4e58-b578-c41c1be4c03e', 'bd8fa507-9798-4e8c-959b-80b4a66ebc19'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:18:34 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:34 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-5eafe867-9fad-4d78-be88-df10ca97ea48 tempest-VolumesTransfersTest-2027999849 None] Transfer volume completed successfully. Sep 09 18:18:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03743e0c-fe85-476f-8fbd-0131f23acf2a" returned: 0 in 0.283s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:18:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe836b8c-f4f9-48c9-a68c-0549cda3822f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03743e0c-fe85-476f-8fbd-0131f23acf2a', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1176e43-57bf-4b9b-8851-b91e06202237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:34 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Volume volume-03743e0c-fe85-476f-8fbd-0131f23acf2a (03743e0c-fe85-476f-8fbd-0131f23acf2a): created successfully Sep 09 18:18:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1176e43-57bf-4b9b-8851-b91e06202237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Flow 'volume_create_manager' (35629a1f-7fd9-40b8-98e0-666eb46fa956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:34 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-df1eccf4-0a35-432b-b68e-cc73d2c51809 tempest-VolumesListAdminTestJSON-308598436 None] Created volume successfully. Sep 09 18:18:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:34 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:18:34 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:35 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.305s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:35 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:18:35 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-e05ae72c-beb2-446e-b6dc-99891194bc83 tempest-GroupsTest-996345343 None] Delete group completed successfully. Sep 09 18:18:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6d4dbe6d-5858-4186-8499-5f9fe6e7ddde tempest-VolumesTransfersTest-1744450356 None] Acquiring lock "cinder-4d028136-7034-4a4e-bd8d-15b42511ecd4-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6d4dbe6d-5858-4186-8499-5f9fe6e7ddde tempest-VolumesTransfersTest-1744450356 None] Lock "cinder-4d028136-7034-4a4e-bd8d-15b42511ecd4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6d4dbe6d-5858-4186-8499-5f9fe6e7ddde tempest-VolumesTransfersTest-1744450356 None] Acquiring lock "cinder-quobyte-4d028136-7034-4a4e-bd8d-15b42511ecd4" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6d4dbe6d-5858-4186-8499-5f9fe6e7ddde tempest-VolumesTransfersTest-1744450356 None] Lock "cinder-quobyte-4d028136-7034-4a4e-bd8d-15b42511ecd4" acquired by "delete_volume" :: waited 0.022s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:35 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a06694-886c-4778-b45a-3e580403d2ea]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:18:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6d4dbe6d-5858-4186-8499-5f9fe6e7ddde tempest-VolumesTransfersTest-1744450356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d028136-7034-4a4e-bd8d-15b42511ecd4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:35 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d028136-7034-4a4e-bd8d-15b42511ecd4 Sep 09 18:18:35 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:35 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-8e523e5c-f0d9-409b-9a1d-243808bc2988 req-aff7c03b-922d-4360-a91d-4103cf8e1272 tempest-AttachVolumeTestJSON-1359511233 None] Terminate volume connection completed successfully. Sep 09 18:18:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-8e523e5c-f0d9-409b-9a1d-243808bc2988 req-aff7c03b-922d-4360-a91d-4103cf8e1272 tempest-AttachVolumeTestJSON-1359511233 None] Deleting attachment ed28f376-4bf9-4b8b-9789-568fe1029e3d. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:18:36 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6d4dbe6d-5858-4186-8499-5f9fe6e7ddde tempest-VolumesTransfersTest-1744450356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d028136-7034-4a4e-bd8d-15b42511ecd4" returned: 0 in 0.498s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6d4dbe6d-5858-4186-8499-5f9fe6e7ddde tempest-VolumesTransfersTest-1744450356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d028136-7034-4a4e-bd8d-15b42511ecd4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:36 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d028136-7034-4a4e-bd8d-15b42511ecd4 Sep 09 18:18:36 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:36 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6d4dbe6d-5858-4186-8499-5f9fe6e7ddde tempest-VolumesTransfersTest-1744450356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d028136-7034-4a4e-bd8d-15b42511ecd4" returned: 0 in 0.339s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6d4dbe6d-5858-4186-8499-5f9fe6e7ddde tempest-VolumesTransfersTest-1744450356 None] Lock "cinder-quobyte-4d028136-7034-4a4e-bd8d-15b42511ecd4" released by "delete_volume" :: held 0.900s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:36 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-6d4dbe6d-5858-4186-8499-5f9fe6e7ddde tempest-VolumesTransfersTest-1744450356 None] Created reservations ['6c8ef481-8243-4311-8f69-9aebceac2706', '24194275-4aec-411b-82e4-0a4e24538b4c', 'de09bec5-5a2d-4c9e-b8a5-5f59dfbf7377', 'd179fa56-606d-470f-9993-fe10b72cf17f'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:18:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6d4dbe6d-5858-4186-8499-5f9fe6e7ddde tempest-VolumesTransfersTest-1744450356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6d4dbe6d-5858-4186-8499-5f9fe6e7ddde tempest-VolumesTransfersTest-1744450356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:36 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6d4dbe6d-5858-4186-8499-5f9fe6e7ddde tempest-VolumesTransfersTest-1744450356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:36 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6d4dbe6d-5858-4186-8499-5f9fe6e7ddde tempest-VolumesTransfersTest-1744450356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6d4dbe6d-5858-4186-8499-5f9fe6e7ddde tempest-VolumesTransfersTest-1744450356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6d4dbe6d-5858-4186-8499-5f9fe6e7ddde tempest-VolumesTransfersTest-1744450356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:36 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:18:36 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:36 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Flow 'volume_create_manager' (c2b9933d-5a07-4f7f-bbbf-198fd3325ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9530e736-e1b4-41f3-afe7-92efdb3385a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9530e736-e1b4-41f3-afe7-92efdb3385a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-695814818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2292bdda-30c3-4a4f-b9da-b2400f48d23c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b68b1c5c6d34cee9905bc1217aea9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:18:37Z,use_quota=True,user_id='9b7b8f1d4f4d47709652431abf292456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6af5c3c-8026-4acc-9611-9cac5b0a3b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6af5c3c-8026-4acc-9611-9cac5b0a3b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee6d727-78a6-4302-8042-f37cc729b736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee6d727-78a6-4302-8042-f37cc729b736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2292bdda-30c3-4a4f-b9da-b2400f48d23c', 'volume_name': 'volume-2292bdda-30c3-4a4f-b9da-b2400f48d23c', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9cd3df-b011-464d-85ab-a4b91862fdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9cd3df-b011-464d-85ab-a4b91862fdec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf4f2d52-b467-4542-b94d-45dfbb81ed70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:37 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Volume 2292bdda-30c3-4a4f-b9da-b2400f48d23c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2292bdda-30c3-4a4f-b9da-b2400f48d23c', 'volume_size': 1} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-695814818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2292bdda-30c3-4a4f-b9da-b2400f48d23c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b68b1c5c6d34cee9905bc1217aea9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:18:37Z,use_quota=True,user_id='9b7b8f1d4f4d47709652431abf292456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Creating volume 2292bdda-30c3-4a4f-b9da-b2400f48d23c {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:37 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:18:37 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2292bdda-30c3-4a4f-b9da-b2400f48d23c 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6d4dbe6d-5858-4186-8499-5f9fe6e7ddde tempest-VolumesTransfersTest-1744450356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.586s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-6d4dbe6d-5858-4186-8499-5f9fe6e7ddde tempest-VolumesTransfersTest-1744450356 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:18:37 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-6d4dbe6d-5858-4186-8499-5f9fe6e7ddde tempest-VolumesTransfersTest-1744450356 None] Deleted volume successfully. Sep 09 18:18:37 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2292bdda-30c3-4a4f-b9da-b2400f48d23c 1073741824 Sep 09 18:18:37 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6d4dbe6d-5858-4186-8499-5f9fe6e7ddde tempest-VolumesTransfersTest-1744450356 None] Lock "cinder-4d028136-7034-4a4e-bd8d-15b42511ecd4-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Flow 'volume_create_manager' (2cf4b25c-97d2-44da-acd9-f39139d62207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0aefcd8-24c1-40a5-87cb-2128bdf0187a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0aefcd8-24c1-40a5-87cb-2128bdf0187a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-764176551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b336d35-a0c2-48c7-998a-02fc3a39d4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfab72c16e74a439b5a676ee5e733c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:18:38Z,use_quota=True,user_id='184e113e4d0b496f85514fceaa78eb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec96eb49-9fa5-46a2-976d-2564a524107a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec96eb49-9fa5-46a2-976d-2564a524107a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30357cc9-5972-4d92-8ef4-9d34b839fc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30357cc9-5972-4d92-8ef4-9d34b839fc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b336d35-a0c2-48c7-998a-02fc3a39d4a4', 'volume_name': 'volume-6b336d35-a0c2-48c7-998a-02fc3a39d4a4', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130b4734-de4a-47e8-84dd-f0bd4e3224b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (130b4734-de4a-47e8-84dd-f0bd4e3224b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:37 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb77af1-3425-43f1-9e21-1a003c98d333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:37 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Volume 6b336d35-a0c2-48c7-998a-02fc3a39d4a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b336d35-a0c2-48c7-998a-02fc3a39d4a4', 'volume_size': 1} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2292bdda-30c3-4a4f-b9da-b2400f48d23c 1073741824" returned: 0 in 0.637s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2292bdda-30c3-4a4f-b9da-b2400f48d23c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:37 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2292bdda-30c3-4a4f-b9da-b2400f48d23c Sep 09 18:18:37 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:38 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2292bdda-30c3-4a4f-b9da-b2400f48d23c" returned: 0 in 0.252s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:18:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.294s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-764176551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b336d35-a0c2-48c7-998a-02fc3a39d4a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bfab72c16e74a439b5a676ee5e733c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:18:38Z,use_quota=True,user_id='184e113e4d0b496f85514fceaa78eb96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:18:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Creating volume 6b336d35-a0c2-48c7-998a-02fc3a39d4a4 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:18:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:18:38 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:18:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6b336d35-a0c2-48c7-998a-02fc3a39d4a4 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf4f2d52-b467-4542-b94d-45dfbb81ed70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2292bdda-30c3-4a4f-b9da-b2400f48d23c', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:38 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6b336d35-a0c2-48c7-998a-02fc3a39d4a4 1073741824 Sep 09 18:18:38 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7a6f9a-7819-4c98-9d94-874852d1d6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:38 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Volume volume-2292bdda-30c3-4a4f-b9da-b2400f48d23c (2292bdda-30c3-4a4f-b9da-b2400f48d23c): created successfully Sep 09 18:18:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7a6f9a-7819-4c98-9d94-874852d1d6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Flow 'volume_create_manager' (c2b9933d-5a07-4f7f-bbbf-198fd3325ace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:38 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-21d45132-4208-4166-9836-6d563de5156f tempest-VolumesListAdminTestJSON-308598436 None] Created volume successfully. Sep 09 18:18:38 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6b336d35-a0c2-48c7-998a-02fc3a39d4a4 1073741824" returned: 0 in 0.539s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6b336d35-a0c2-48c7-998a-02fc3a39d4a4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:38 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6b336d35-a0c2-48c7-998a-02fc3a39d4a4 Sep 09 18:18:38 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:39 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6b336d35-a0c2-48c7-998a-02fc3a39d4a4" returned: 0 in 0.411s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb77af1-3425-43f1-9e21-1a003c98d333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b336d35-a0c2-48c7-998a-02fc3a39d4a4', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ec4c3b-5e0d-4489-b73a-9d36c1fd5566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:39 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Volume volume-6b336d35-a0c2-48c7-998a-02fc3a39d4a4 (6b336d35-a0c2-48c7-998a-02fc3a39d4a4): created successfully Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29ec4c3b-5e0d-4489-b73a-9d36c1fd5566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Flow 'volume_create_manager' (2cf4b25c-97d2-44da-acd9-f39139d62207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:39 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-41cdf6f4-f979-4321-8ed3-76b63b15857f tempest-VolumesTransfersTest-1875607132 None] Created volume successfully. Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Flow 'volume_create_manager' (fd8c3d48-f8f8-4c0c-bc67-912717ba9f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d8f9f0-87b5-4dc2-a24d-d9d3479962d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d8f9f0-87b5-4dc2-a24d-d9d3479962d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-450609754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a04a73df-a53c-409f-aa36-9e6819e490a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b68b1c5c6d34cee9905bc1217aea9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:18:40Z,use_quota=True,user_id='9b7b8f1d4f4d47709652431abf292456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5912bd20-3d10-453d-ab89-33c53c64de3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5912bd20-3d10-453d-ab89-33c53c64de3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d156bea2-4ae8-4da4-b67f-5b352234c789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d156bea2-4ae8-4da4-b67f-5b352234c789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a04a73df-a53c-409f-aa36-9e6819e490a2', 'volume_name': 'volume-a04a73df-a53c-409f-aa36-9e6819e490a2', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e2267f1-6f89-401d-8233-99aaf13f925a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e2267f1-6f89-401d-8233-99aaf13f925a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a116f46b-7334-4890-bac2-038e5e5ac67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:39 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Volume a04a73df-a53c-409f-aa36-9e6819e490a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a04a73df-a53c-409f-aa36-9e6819e490a2', 'volume_size': 1} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-450609754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a04a73df-a53c-409f-aa36-9e6819e490a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b68b1c5c6d34cee9905bc1217aea9b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:18:40Z,use_quota=True,user_id='9b7b8f1d4f4d47709652431abf292456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Creating volume a04a73df-a53c-409f-aa36-9e6819e490a2 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:18:39 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:18:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a04a73df-a53c-409f-aa36-9e6819e490a2 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:39 devstack sudo[97025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a04a73df-a53c-409f-aa36-9e6819e490a2 1073741824 Sep 09 18:18:39 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:40 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e55fb4e4-18b3-4880-b95f-5af685ff1cfe tempest-VolumesTransfersTest-1744450356 None] Acquiring lock "cinder-6b336d35-a0c2-48c7-998a-02fc3a39d4a4-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:40 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e55fb4e4-18b3-4880-b95f-5af685ff1cfe tempest-VolumesTransfersTest-1744450356 None] Lock "cinder-6b336d35-a0c2-48c7-998a-02fc3a39d4a4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:40 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e55fb4e4-18b3-4880-b95f-5af685ff1cfe tempest-VolumesTransfersTest-1744450356 None] Acquiring lock "cinder-quobyte-6b336d35-a0c2-48c7-998a-02fc3a39d4a4" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:40 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e55fb4e4-18b3-4880-b95f-5af685ff1cfe tempest-VolumesTransfersTest-1744450356 None] Lock "cinder-quobyte-6b336d35-a0c2-48c7-998a-02fc3a39d4a4" acquired by "delete_volume" :: waited 0.033s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:40 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[664f0df5-3e82-49d6-96ca-20f19c558631]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:18:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e55fb4e4-18b3-4880-b95f-5af685ff1cfe tempest-VolumesTransfersTest-1744450356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6b336d35-a0c2-48c7-998a-02fc3a39d4a4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:40 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6b336d35-a0c2-48c7-998a-02fc3a39d4a4 Sep 09 18:18:40 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:40 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a04a73df-a53c-409f-aa36-9e6819e490a2 1073741824" returned: 0 in 1.007s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a04a73df-a53c-409f-aa36-9e6819e490a2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:40 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a04a73df-a53c-409f-aa36-9e6819e490a2 Sep 09 18:18:40 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:41 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e55fb4e4-18b3-4880-b95f-5af685ff1cfe tempest-VolumesTransfersTest-1744450356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6b336d35-a0c2-48c7-998a-02fc3a39d4a4" returned: 0 in 0.545s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e55fb4e4-18b3-4880-b95f-5af685ff1cfe tempest-VolumesTransfersTest-1744450356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6b336d35-a0c2-48c7-998a-02fc3a39d4a4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:41 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6b336d35-a0c2-48c7-998a-02fc3a39d4a4 Sep 09 18:18:41 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:41 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a04a73df-a53c-409f-aa36-9e6819e490a2" returned: 0 in 0.355s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:41 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:18:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:41 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a116f46b-7334-4890-bac2-038e5e5ac67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a04a73df-a53c-409f-aa36-9e6819e490a2', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:41 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b1e58aa-ce11-4dc1-90d5-1753e9891837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:41 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Volume volume-a04a73df-a53c-409f-aa36-9e6819e490a2 (a04a73df-a53c-409f-aa36-9e6819e490a2): created successfully Sep 09 18:18:41 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b1e58aa-ce11-4dc1-90d5-1753e9891837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:41 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Flow 'volume_create_manager' (fd8c3d48-f8f8-4c0c-bc67-912717ba9f19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:41 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-c1632088-3cbf-4df0-ad43-abf074e57db1 tempest-VolumesListAdminTestJSON-308598436 None] Created volume successfully. Sep 09 18:18:41 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e55fb4e4-18b3-4880-b95f-5af685ff1cfe tempest-VolumesTransfersTest-1744450356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6b336d35-a0c2-48c7-998a-02fc3a39d4a4" returned: 0 in 0.370s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:41 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e55fb4e4-18b3-4880-b95f-5af685ff1cfe tempest-VolumesTransfersTest-1744450356 None] Lock "cinder-quobyte-6b336d35-a0c2-48c7-998a-02fc3a39d4a4" released by "delete_volume" :: held 1.005s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:41 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-e55fb4e4-18b3-4880-b95f-5af685ff1cfe tempest-VolumesTransfersTest-1744450356 None] Created reservations ['de6fb8e8-dfca-4630-a2ab-62c7ddf05baf', 'ec5e1eb8-ed4a-4998-9124-494b573d5e53', '70593c93-a76c-4d02-98bd-427ac60a93b5', 'c8ff93e4-268f-4571-94d3-ba4eee565ef7'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:18:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e55fb4e4-18b3-4880-b95f-5af685ff1cfe tempest-VolumesTransfersTest-1744450356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e55fb4e4-18b3-4880-b95f-5af685ff1cfe tempest-VolumesTransfersTest-1744450356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:41 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e55fb4e4-18b3-4880-b95f-5af685ff1cfe tempest-VolumesTransfersTest-1744450356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:41 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e55fb4e4-18b3-4880-b95f-5af685ff1cfe tempest-VolumesTransfersTest-1744450356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e55fb4e4-18b3-4880-b95f-5af685ff1cfe tempest-VolumesTransfersTest-1744450356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e55fb4e4-18b3-4880-b95f-5af685ff1cfe tempest-VolumesTransfersTest-1744450356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:41 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:18:41 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:42 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e55fb4e4-18b3-4880-b95f-5af685ff1cfe tempest-VolumesTransfersTest-1744450356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.489s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:42 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-e55fb4e4-18b3-4880-b95f-5af685ff1cfe tempest-VolumesTransfersTest-1744450356 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:18:42 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-e55fb4e4-18b3-4880-b95f-5af685ff1cfe tempest-VolumesTransfersTest-1744450356 None] Deleted volume successfully. Sep 09 18:18:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e55fb4e4-18b3-4880-b95f-5af685ff1cfe tempest-VolumesTransfersTest-1744450356 None] Lock "cinder-6b336d35-a0c2-48c7-998a-02fc3a39d4a4-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:43 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:18:43 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:18:43 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Flow 'volume_create_manager' (24ee8dd9-3f89-41e3-a86f-8d03264aaff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e07ee7-a171-495c-9c97-acca3581b722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.408s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e07ee7-a171-495c-9c97-acca3581b722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07709f97-1986-4568-8977-7c27ad01766d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ffba7b2ccc449cb55f58ffadc730f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:18:43Z,use_quota=True,user_id='43c92ec9481c47e6b6f46eceaa0c668a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54112951-60e2-4ecf-97f2-3932704c700e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54112951-60e2-4ecf-97f2-3932704c700e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6bf5ba-83c3-404f-9033-523dd3da4294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6bf5ba-83c3-404f-9033-523dd3da4294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07709f97-1986-4568-8977-7c27ad01766d', 'volume_name': 'volume-07709f97-1986-4568-8977-7c27ad01766d', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e9a42b-ed65-433c-a734-e72af49484b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e9a42b-ed65-433c-a734-e72af49484b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d3d6b78-6cae-46a5-9b14-a1d7975af149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:43 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Volume 07709f97-1986-4568-8977-7c27ad01766d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07709f97-1986-4568-8977-7c27ad01766d', 'volume_size': 1} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07709f97-1986-4568-8977-7c27ad01766d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ffba7b2ccc449cb55f58ffadc730f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:18:43Z,use_quota=True,user_id='43c92ec9481c47e6b6f46eceaa0c668a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Creating volume 07709f97-1986-4568-8977-7c27ad01766d {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:18:43 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-07709f97-1986-4568-8977-7c27ad01766d 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 28 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:18:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:18:43 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-07709f97-1986-4568-8977-7c27ad01766d 1073741824 Sep 09 18:18:43 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:44 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-07709f97-1986-4568-8977-7c27ad01766d 1073741824" returned: 0 in 0.593s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-07709f97-1986-4568-8977-7c27ad01766d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:44 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-07709f97-1986-4568-8977-7c27ad01766d Sep 09 18:18:44 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:44 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-390ea883-2956-4443-a58f-d35a8c5919de tempest-GroupsV320Test-168675678 None] Group tempest-GroupsV320Test-Group-412174086: creating Sep 09 18:18:44 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-390ea883-2956-4443-a58f-d35a8c5919de tempest-GroupsV320Test-168675678 None] Group tempest-GroupsV320Test-Group-412174086: created successfully Sep 09 18:18:44 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-390ea883-2956-4443-a58f-d35a8c5919de tempest-GroupsV320Test-168675678 None] Create group completed successfully. Sep 09 18:18:44 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-07709f97-1986-4568-8977-7c27ad01766d" returned: 0 in 0.370s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:44 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:18:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:44 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d3d6b78-6cae-46a5-9b14-a1d7975af149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07709f97-1986-4568-8977-7c27ad01766d', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:44 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22206634-992f-44df-ad4d-a573e79bdbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:44 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Volume volume-07709f97-1986-4568-8977-7c27ad01766d (07709f97-1986-4568-8977-7c27ad01766d): created successfully Sep 09 18:18:44 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22206634-992f-44df-ad4d-a573e79bdbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:44 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Flow 'volume_create_manager' (24ee8dd9-3f89-41e3-a86f-8d03264aaff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:44 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-6fe03dbd-e9af-4369-85af-161d04aa613c tempest-VolumesListAdminTestJSON-1242171653 None] Created volume successfully. Sep 09 18:18:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b94b14bf-f17f-4169-ba0f-d4865a7aa6e0 tempest-VolumesListAdminTestJSON-1242171653 None] Acquiring lock "cinder-07709f97-1986-4568-8977-7c27ad01766d-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b94b14bf-f17f-4169-ba0f-d4865a7aa6e0 tempest-VolumesListAdminTestJSON-1242171653 None] Lock "cinder-07709f97-1986-4568-8977-7c27ad01766d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b94b14bf-f17f-4169-ba0f-d4865a7aa6e0 tempest-VolumesListAdminTestJSON-1242171653 None] Acquiring lock "cinder-quobyte-07709f97-1986-4568-8977-7c27ad01766d" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b94b14bf-f17f-4169-ba0f-d4865a7aa6e0 tempest-VolumesListAdminTestJSON-1242171653 None] Lock "cinder-quobyte-07709f97-1986-4568-8977-7c27ad01766d" acquired by "delete_volume" :: waited 0.042s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:45 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2a405b-f8ae-43f3-838a-b42507cb4688]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:18:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b94b14bf-f17f-4169-ba0f-d4865a7aa6e0 tempest-VolumesListAdminTestJSON-1242171653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-07709f97-1986-4568-8977-7c27ad01766d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2063f218-7dd0-439b-8f50-66e44dbddb86 tempest-VolumesListAdminTestJSON-308598436 None] Acquiring lock "cinder-a04a73df-a53c-409f-aa36-9e6819e490a2-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:46 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2063f218-7dd0-439b-8f50-66e44dbddb86 tempest-VolumesListAdminTestJSON-308598436 None] Lock "cinder-a04a73df-a53c-409f-aa36-9e6819e490a2-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:46 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2063f218-7dd0-439b-8f50-66e44dbddb86 tempest-VolumesListAdminTestJSON-308598436 None] Acquiring lock "cinder-quobyte-a04a73df-a53c-409f-aa36-9e6819e490a2" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:46 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2063f218-7dd0-439b-8f50-66e44dbddb86 tempest-VolumesListAdminTestJSON-308598436 None] Lock "cinder-quobyte-a04a73df-a53c-409f-aa36-9e6819e490a2" acquired by "delete_volume" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:46 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-07709f97-1986-4568-8977-7c27ad01766d Sep 09 18:18:46 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:46 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d199ebf-fb33-4148-bc55-dc14bfc9ea47]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:18:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2063f218-7dd0-439b-8f50-66e44dbddb86 tempest-VolumesListAdminTestJSON-308598436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a04a73df-a53c-409f-aa36-9e6819e490a2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:46 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-e7d38b55-95cb-4cbf-a2aa-a4de9c32cb8a tempest-GroupsV320Test-168675678 None] Created reservations ['12eea0f6-3f81-46b7-91d2-d78dc6c253b0'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:18:46 devstack sudo[97157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a04a73df-a53c-409f-aa36-9e6819e490a2 Sep 09 18:18:46 devstack sudo[97157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e7d38b55-95cb-4cbf-a2aa-a4de9c32cb8a tempest-GroupsV320Test-168675678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e7d38b55-95cb-4cbf-a2aa-a4de9c32cb8a tempest-GroupsV320Test-168675678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:46 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e7d38b55-95cb-4cbf-a2aa-a4de9c32cb8a tempest-GroupsV320Test-168675678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:46 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e7d38b55-95cb-4cbf-a2aa-a4de9c32cb8a tempest-GroupsV320Test-168675678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e7d38b55-95cb-4cbf-a2aa-a4de9c32cb8a tempest-GroupsV320Test-168675678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e7d38b55-95cb-4cbf-a2aa-a4de9c32cb8a tempest-GroupsV320Test-168675678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:46 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:18:46 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:46 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b94b14bf-f17f-4169-ba0f-d4865a7aa6e0 tempest-VolumesListAdminTestJSON-1242171653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-07709f97-1986-4568-8977-7c27ad01766d" returned: 0 in 0.737s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b94b14bf-f17f-4169-ba0f-d4865a7aa6e0 tempest-VolumesListAdminTestJSON-1242171653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-07709f97-1986-4568-8977-7c27ad01766d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:46 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-07709f97-1986-4568-8977-7c27ad01766d Sep 09 18:18:46 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:46 devstack sudo[97157]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2063f218-7dd0-439b-8f50-66e44dbddb86 tempest-VolumesListAdminTestJSON-308598436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a04a73df-a53c-409f-aa36-9e6819e490a2" returned: 0 in 0.576s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2063f218-7dd0-439b-8f50-66e44dbddb86 tempest-VolumesListAdminTestJSON-308598436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a04a73df-a53c-409f-aa36-9e6819e490a2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:46 devstack sudo[97171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a04a73df-a53c-409f-aa36-9e6819e490a2 Sep 09 18:18:46 devstack sudo[97171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:46 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e7d38b55-95cb-4cbf-a2aa-a4de9c32cb8a tempest-GroupsV320Test-168675678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.421s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:46 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-e7d38b55-95cb-4cbf-a2aa-a4de9c32cb8a tempest-GroupsV320Test-168675678 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:18:46 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-e7d38b55-95cb-4cbf-a2aa-a4de9c32cb8a tempest-GroupsV320Test-168675678 None] Delete group completed successfully. Sep 09 18:18:47 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b94b14bf-f17f-4169-ba0f-d4865a7aa6e0 tempest-VolumesListAdminTestJSON-1242171653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-07709f97-1986-4568-8977-7c27ad01766d" returned: 0 in 0.414s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b94b14bf-f17f-4169-ba0f-d4865a7aa6e0 tempest-VolumesListAdminTestJSON-1242171653 None] Lock "cinder-quobyte-07709f97-1986-4568-8977-7c27ad01766d" released by "delete_volume" :: held 1.241s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-b94b14bf-f17f-4169-ba0f-d4865a7aa6e0 tempest-VolumesListAdminTestJSON-1242171653 None] Created reservations ['1361a0a3-6b54-44fa-b7ee-7b25f443e0ca', '6c51133e-db81-42c5-8d3f-30a14157c0a0', '1291d7f0-cddc-4df3-9da9-6bc0ec90189b', 'dd1223f3-ae8b-4d3e-b458-b6d80f423cfd'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:18:47 devstack sudo[97171]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2063f218-7dd0-439b-8f50-66e44dbddb86 tempest-VolumesListAdminTestJSON-308598436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a04a73df-a53c-409f-aa36-9e6819e490a2" returned: 0 in 0.405s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2063f218-7dd0-439b-8f50-66e44dbddb86 tempest-VolumesListAdminTestJSON-308598436 None] Lock "cinder-quobyte-a04a73df-a53c-409f-aa36-9e6819e490a2" released by "delete_volume" :: held 1.060s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b94b14bf-f17f-4169-ba0f-d4865a7aa6e0 tempest-VolumesListAdminTestJSON-1242171653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b94b14bf-f17f-4169-ba0f-d4865a7aa6e0 tempest-VolumesListAdminTestJSON-1242171653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b94b14bf-f17f-4169-ba0f-d4865a7aa6e0 tempest-VolumesListAdminTestJSON-1242171653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b94b14bf-f17f-4169-ba0f-d4865a7aa6e0 tempest-VolumesListAdminTestJSON-1242171653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b94b14bf-f17f-4169-ba0f-d4865a7aa6e0 tempest-VolumesListAdminTestJSON-1242171653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b94b14bf-f17f-4169-ba0f-d4865a7aa6e0 tempest-VolumesListAdminTestJSON-1242171653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:47 devstack sudo[97176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:18:47 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-2063f218-7dd0-439b-8f50-66e44dbddb86 tempest-VolumesListAdminTestJSON-308598436 None] Created reservations ['65a1a6b7-6c26-473a-be4b-9b69da06958f', '30c30258-07b7-4fbe-8306-25e1e039e794', '52454aa2-06fe-48af-8933-2250e2bc9234', 'cff15669-16ec-4631-a561-b7ecd7cc4829'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2063f218-7dd0-439b-8f50-66e44dbddb86 tempest-VolumesListAdminTestJSON-308598436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2063f218-7dd0-439b-8f50-66e44dbddb86 tempest-VolumesListAdminTestJSON-308598436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2063f218-7dd0-439b-8f50-66e44dbddb86 tempest-VolumesListAdminTestJSON-308598436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2063f218-7dd0-439b-8f50-66e44dbddb86 tempest-VolumesListAdminTestJSON-308598436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2063f218-7dd0-439b-8f50-66e44dbddb86 tempest-VolumesListAdminTestJSON-308598436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2063f218-7dd0-439b-8f50-66e44dbddb86 tempest-VolumesListAdminTestJSON-308598436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:47 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:18:47 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:47 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b94b14bf-f17f-4169-ba0f-d4865a7aa6e0 tempest-VolumesListAdminTestJSON-1242171653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.364s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-b94b14bf-f17f-4169-ba0f-d4865a7aa6e0 tempest-VolumesListAdminTestJSON-1242171653 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:18:47 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-b94b14bf-f17f-4169-ba0f-d4865a7aa6e0 tempest-VolumesListAdminTestJSON-1242171653 None] Deleted volume successfully. Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b94b14bf-f17f-4169-ba0f-d4865a7aa6e0 tempest-VolumesListAdminTestJSON-1242171653 None] Lock "cinder-07709f97-1986-4568-8977-7c27ad01766d-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:47 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2063f218-7dd0-439b-8f50-66e44dbddb86 tempest-VolumesListAdminTestJSON-308598436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.434s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-2063f218-7dd0-439b-8f50-66e44dbddb86 tempest-VolumesListAdminTestJSON-308598436 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:18:47 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-2063f218-7dd0-439b-8f50-66e44dbddb86 tempest-VolumesListAdminTestJSON-308598436 None] Deleted volume successfully. Sep 09 18:18:47 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2063f218-7dd0-439b-8f50-66e44dbddb86 tempest-VolumesListAdminTestJSON-308598436 None] Lock "cinder-a04a73df-a53c-409f-aa36-9e6819e490a2-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-538b085b-0ea5-4397-8555-2cde99d9696e tempest-VolumesListAdminTestJSON-308598436 None] Acquiring lock "cinder-2292bdda-30c3-4a4f-b9da-b2400f48d23c-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-538b085b-0ea5-4397-8555-2cde99d9696e tempest-VolumesListAdminTestJSON-308598436 None] Lock "cinder-2292bdda-30c3-4a4f-b9da-b2400f48d23c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-538b085b-0ea5-4397-8555-2cde99d9696e tempest-VolumesListAdminTestJSON-308598436 None] Acquiring lock "cinder-quobyte-2292bdda-30c3-4a4f-b9da-b2400f48d23c" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-538b085b-0ea5-4397-8555-2cde99d9696e tempest-VolumesListAdminTestJSON-308598436 None] Lock "cinder-quobyte-2292bdda-30c3-4a4f-b9da-b2400f48d23c" acquired by "delete_volume" :: waited 0.028s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:48 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[80700fc0-967e-49b9-91bd-0458bfa97e62]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:18:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-538b085b-0ea5-4397-8555-2cde99d9696e tempest-VolumesListAdminTestJSON-308598436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2292bdda-30c3-4a4f-b9da-b2400f48d23c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:48 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2292bdda-30c3-4a4f-b9da-b2400f48d23c Sep 09 18:18:48 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:49 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-538b085b-0ea5-4397-8555-2cde99d9696e tempest-VolumesListAdminTestJSON-308598436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2292bdda-30c3-4a4f-b9da-b2400f48d23c" returned: 0 in 0.522s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-538b085b-0ea5-4397-8555-2cde99d9696e tempest-VolumesListAdminTestJSON-308598436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2292bdda-30c3-4a4f-b9da-b2400f48d23c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:49 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2292bdda-30c3-4a4f-b9da-b2400f48d23c Sep 09 18:18:49 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:49 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-538b085b-0ea5-4397-8555-2cde99d9696e tempest-VolumesListAdminTestJSON-308598436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2292bdda-30c3-4a4f-b9da-b2400f48d23c" returned: 0 in 0.285s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-538b085b-0ea5-4397-8555-2cde99d9696e tempest-VolumesListAdminTestJSON-308598436 None] Lock "cinder-quobyte-2292bdda-30c3-4a4f-b9da-b2400f48d23c" released by "delete_volume" :: held 0.878s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:49 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-538b085b-0ea5-4397-8555-2cde99d9696e tempest-VolumesListAdminTestJSON-308598436 None] Created reservations ['8c83e225-30cb-465b-9a75-132de3b93c2a', '36e8d8d3-bdaf-49bf-a076-a67e60f61c65', 'da02c7ca-27ef-41fe-bd04-c02cb16b62f4', '87dae675-df9b-445e-b17b-b2f92a0e0793'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:18:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-538b085b-0ea5-4397-8555-2cde99d9696e tempest-VolumesListAdminTestJSON-308598436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-538b085b-0ea5-4397-8555-2cde99d9696e tempest-VolumesListAdminTestJSON-308598436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:49 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-538b085b-0ea5-4397-8555-2cde99d9696e tempest-VolumesListAdminTestJSON-308598436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:49 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-538b085b-0ea5-4397-8555-2cde99d9696e tempest-VolumesListAdminTestJSON-308598436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-538b085b-0ea5-4397-8555-2cde99d9696e tempest-VolumesListAdminTestJSON-308598436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-538b085b-0ea5-4397-8555-2cde99d9696e tempest-VolumesListAdminTestJSON-308598436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:49 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:18:49 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8b692de8-82b5-4810-8cdf-be36be36462d tempest-VolumesListAdminTestJSON-308598436 None] Acquiring lock "cinder-03743e0c-fe85-476f-8fbd-0131f23acf2a-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8b692de8-82b5-4810-8cdf-be36be36462d tempest-VolumesListAdminTestJSON-308598436 None] Lock "cinder-03743e0c-fe85-476f-8fbd-0131f23acf2a-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8b692de8-82b5-4810-8cdf-be36be36462d tempest-VolumesListAdminTestJSON-308598436 None] Acquiring lock "cinder-quobyte-03743e0c-fe85-476f-8fbd-0131f23acf2a" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8b692de8-82b5-4810-8cdf-be36be36462d tempest-VolumesListAdminTestJSON-308598436 None] Lock "cinder-quobyte-03743e0c-fe85-476f-8fbd-0131f23acf2a" acquired by "delete_volume" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:50 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-538b085b-0ea5-4397-8555-2cde99d9696e tempest-VolumesListAdminTestJSON-308598436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.498s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:50 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-538b085b-0ea5-4397-8555-2cde99d9696e tempest-VolumesListAdminTestJSON-308598436 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:18:50 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-538b085b-0ea5-4397-8555-2cde99d9696e tempest-VolumesListAdminTestJSON-308598436 None] Deleted volume successfully. Sep 09 18:18:50 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4a9c7a-4736-4fab-b4f2-c0cf5a858e20]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:18:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8b692de8-82b5-4810-8cdf-be36be36462d tempest-VolumesListAdminTestJSON-308598436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03743e0c-fe85-476f-8fbd-0131f23acf2a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-538b085b-0ea5-4397-8555-2cde99d9696e tempest-VolumesListAdminTestJSON-308598436 None] Lock "cinder-2292bdda-30c3-4a4f-b9da-b2400f48d23c-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:50 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03743e0c-fe85-476f-8fbd-0131f23acf2a Sep 09 18:18:50 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:50 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8b692de8-82b5-4810-8cdf-be36be36462d tempest-VolumesListAdminTestJSON-308598436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03743e0c-fe85-476f-8fbd-0131f23acf2a" returned: 0 in 0.569s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8b692de8-82b5-4810-8cdf-be36be36462d tempest-VolumesListAdminTestJSON-308598436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03743e0c-fe85-476f-8fbd-0131f23acf2a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:50 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03743e0c-fe85-476f-8fbd-0131f23acf2a Sep 09 18:18:50 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:50 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8b692de8-82b5-4810-8cdf-be36be36462d tempest-VolumesListAdminTestJSON-308598436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03743e0c-fe85-476f-8fbd-0131f23acf2a" returned: 0 in 0.322s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8b692de8-82b5-4810-8cdf-be36be36462d tempest-VolumesListAdminTestJSON-308598436 None] Lock "cinder-quobyte-03743e0c-fe85-476f-8fbd-0131f23acf2a" released by "delete_volume" :: held 0.961s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:51 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-8b692de8-82b5-4810-8cdf-be36be36462d tempest-VolumesListAdminTestJSON-308598436 None] Created reservations ['b42d86e0-2e7c-4df6-914c-1d435a0ea336', 'e46b186a-0dc2-49be-87fe-3470742659ad', '8c2b0179-d8b0-4f0e-8733-6088d29badd5', '62a84fc9-29aa-41ae-8e3f-47a34d432f45'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:18:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8b692de8-82b5-4810-8cdf-be36be36462d tempest-VolumesListAdminTestJSON-308598436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8b692de8-82b5-4810-8cdf-be36be36462d tempest-VolumesListAdminTestJSON-308598436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8b692de8-82b5-4810-8cdf-be36be36462d tempest-VolumesListAdminTestJSON-308598436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8b692de8-82b5-4810-8cdf-be36be36462d tempest-VolumesListAdminTestJSON-308598436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8b692de8-82b5-4810-8cdf-be36be36462d tempest-VolumesListAdminTestJSON-308598436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8b692de8-82b5-4810-8cdf-be36be36462d tempest-VolumesListAdminTestJSON-308598436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:51 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:18:51 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:51 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8b692de8-82b5-4810-8cdf-be36be36462d tempest-VolumesListAdminTestJSON-308598436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.402s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:51 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-8b692de8-82b5-4810-8cdf-be36be36462d tempest-VolumesListAdminTestJSON-308598436 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:18:51 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-8b692de8-82b5-4810-8cdf-be36be36462d tempest-VolumesListAdminTestJSON-308598436 None] Deleted volume successfully. Sep 09 18:18:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8b692de8-82b5-4810-8cdf-be36be36462d tempest-VolumesListAdminTestJSON-308598436 None] Lock "cinder-03743e0c-fe85-476f-8fbd-0131f23acf2a-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:52 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:18:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Flow 'volume_create_manager' (8ab10838-7488-4840-8709-23ce56ccac6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac36da6-9149-4acc-afa5-d1173857a97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac36da6-9149-4acc-afa5-d1173857a97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1746766267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da808a4f-baba-46f7-874c-6d9f46fb64c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea61102632ea45f386a69053a9a8087e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:18:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:18:52Z,use_quota=True,user_id='c10c1f78216242bba1bda8c232b6149f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e07ab3-7033-494b-ae7f-6e313a4f9031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7e07ab3-7033-494b-ae7f-6e313a4f9031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49614946-b156-4df9-b33f-f3862908c4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49614946-b156-4df9-b33f-f3862908c4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da808a4f-baba-46f7-874c-6d9f46fb64c4', 'volume_name': 'volume-da808a4f-baba-46f7-874c-6d9f46fb64c4', 'volume_size': 2}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d0d5df-cc38-4d14-9173-e72612ce15f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10d0d5df-cc38-4d14-9173-e72612ce15f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e4e7fb5-ab96-4341-a990-1d64fdf1509f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:52 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Volume da808a4f-baba-46f7-874c-6d9f46fb64c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da808a4f-baba-46f7-874c-6d9f46fb64c4', 'volume_size': 2} Sep 09 18:18:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:18:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1746766267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da808a4f-baba-46f7-874c-6d9f46fb64c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea61102632ea45f386a69053a9a8087e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:18:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:18:52Z,use_quota=True,user_id='c10c1f78216242bba1bda8c232b6149f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:18:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Creating volume da808a4f-baba-46f7-874c-6d9f46fb64c4 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:18:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:18:52 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:18:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-da808a4f-baba-46f7-874c-6d9f46fb64c4 2147483648 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:52 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-da808a4f-baba-46f7-874c-6d9f46fb64c4 2147483648 Sep 09 18:18:52 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:53 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-da808a4f-baba-46f7-874c-6d9f46fb64c4 2147483648" returned: 0 in 0.629s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-da808a4f-baba-46f7-874c-6d9f46fb64c4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:53 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-da808a4f-baba-46f7-874c-6d9f46fb64c4 Sep 09 18:18:53 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:53 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-da808a4f-baba-46f7-874c-6d9f46fb64c4" returned: 0 in 0.419s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:18:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e4e7fb5-ab96-4341-a990-1d64fdf1509f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da808a4f-baba-46f7-874c-6d9f46fb64c4', 'volume_size': 2}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24159f1-0cdd-42f9-bfbf-264134dad6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:18:53 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Volume volume-da808a4f-baba-46f7-874c-6d9f46fb64c4 (da808a4f-baba-46f7-874c-6d9f46fb64c4): created successfully Sep 09 18:18:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24159f1-0cdd-42f9-bfbf-264134dad6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:18:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Flow 'volume_create_manager' (8ab10838-7488-4840-8709-23ce56ccac6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:18:53 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-13af48ec-867e-43b0-afde-45afcbce2186 tempest-VolumesCloneNegativeTest-1186674034 None] Created volume successfully. Sep 09 18:18:54 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6155e627-08f8-4b03-a688-8fbfba40bf30 tempest-VolumesCloneNegativeTest-1186674034 None] Acquiring lock "cinder-da808a4f-baba-46f7-874c-6d9f46fb64c4-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:54 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6155e627-08f8-4b03-a688-8fbfba40bf30 tempest-VolumesCloneNegativeTest-1186674034 None] Lock "cinder-da808a4f-baba-46f7-874c-6d9f46fb64c4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:54 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6155e627-08f8-4b03-a688-8fbfba40bf30 tempest-VolumesCloneNegativeTest-1186674034 None] Acquiring lock "cinder-quobyte-da808a4f-baba-46f7-874c-6d9f46fb64c4" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:18:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6155e627-08f8-4b03-a688-8fbfba40bf30 tempest-VolumesCloneNegativeTest-1186674034 None] Lock "cinder-quobyte-da808a4f-baba-46f7-874c-6d9f46fb64c4" acquired by "delete_volume" :: waited 0.029s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:18:55 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0032c2c5-bf97-499d-89e5-2316188e79fb]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:18:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6155e627-08f8-4b03-a688-8fbfba40bf30 tempest-VolumesCloneNegativeTest-1186674034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-da808a4f-baba-46f7-874c-6d9f46fb64c4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:55 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-da808a4f-baba-46f7-874c-6d9f46fb64c4 Sep 09 18:18:55 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:55 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6155e627-08f8-4b03-a688-8fbfba40bf30 tempest-VolumesCloneNegativeTest-1186674034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-da808a4f-baba-46f7-874c-6d9f46fb64c4" returned: 0 in 0.530s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6155e627-08f8-4b03-a688-8fbfba40bf30 tempest-VolumesCloneNegativeTest-1186674034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-da808a4f-baba-46f7-874c-6d9f46fb64c4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:55 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-da808a4f-baba-46f7-874c-6d9f46fb64c4 Sep 09 18:18:55 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:55 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6155e627-08f8-4b03-a688-8fbfba40bf30 tempest-VolumesCloneNegativeTest-1186674034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-da808a4f-baba-46f7-874c-6d9f46fb64c4" returned: 0 in 0.320s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6155e627-08f8-4b03-a688-8fbfba40bf30 tempest-VolumesCloneNegativeTest-1186674034 None] Lock "cinder-quobyte-da808a4f-baba-46f7-874c-6d9f46fb64c4" released by "delete_volume" :: held 0.927s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:18:56 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-6155e627-08f8-4b03-a688-8fbfba40bf30 tempest-VolumesCloneNegativeTest-1186674034 None] Created reservations ['ce4bdf0b-9cee-45b8-8916-a1f3031d79c0', '4224a55d-a44d-41f3-8668-d9ad93790f98', '711d8b2f-5010-48f0-a213-c05ba2e8ac7e', '0bccf06a-ee16-4704-9d61-8237b0b986ba'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:18:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6155e627-08f8-4b03-a688-8fbfba40bf30 tempest-VolumesCloneNegativeTest-1186674034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:18:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6155e627-08f8-4b03-a688-8fbfba40bf30 tempest-VolumesCloneNegativeTest-1186674034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:18:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6155e627-08f8-4b03-a688-8fbfba40bf30 tempest-VolumesCloneNegativeTest-1186674034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:18:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6155e627-08f8-4b03-a688-8fbfba40bf30 tempest-VolumesCloneNegativeTest-1186674034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:18:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6155e627-08f8-4b03-a688-8fbfba40bf30 tempest-VolumesCloneNegativeTest-1186674034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:18:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6155e627-08f8-4b03-a688-8fbfba40bf30 tempest-VolumesCloneNegativeTest-1186674034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:18:56 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:18:56 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:18:56 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Sep 09 18:18:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6155e627-08f8-4b03-a688-8fbfba40bf30 tempest-VolumesCloneNegativeTest-1186674034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.315s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:18:56 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-6155e627-08f8-4b03-a688-8fbfba40bf30 tempest-VolumesCloneNegativeTest-1186674034 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:18:56 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-6155e627-08f8-4b03-a688-8fbfba40bf30 tempest-VolumesCloneNegativeTest-1186674034 None] Deleted volume successfully. Sep 09 18:18:56 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6155e627-08f8-4b03-a688-8fbfba40bf30 tempest-VolumesCloneNegativeTest-1186674034 None] Lock "cinder-da808a4f-baba-46f7-874c-6d9f46fb64c4-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:06 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=89,cinder:UPDATE=110,cinder:INSERT=23,cinder:DELETE=6 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:19:06 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:INSERT=28,cinder:UPDATE=129,cinder:SELECT=86,cinder:DELETE=10 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:19:09 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:19:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Flow 'volume_create_manager' (11069181-a187-4c03-a389-2fee8b0337ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:19:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9748fa7-4dce-4edf-936f-1ed40ec2b9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9748fa7-4dce-4edf-936f-1ed40ec2b9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-810136149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afe203f-c3c9-41c4-a5d6-0445927c9a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bcb7b36c6242f8b3be0a915a296f98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:19:09Z,use_quota=True,user_id='8f45417d035947d9b064c8849423fdb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a710e10-d492-42df-aa1d-a35bc34b53e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a710e10-d492-42df-aa1d-a35bc34b53e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e59030-2b05-42ad-9d02-9c58b060c2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:09 devstack cinder-volume[87639]: DEBUG cinder.image.glance [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Creating Keystone auth plugin from conf {{(pid=87639) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 18:19:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0e59030-2b05-42ad-9d02-9c58b060c2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6afe203f-c3c9-41c4-a5d6-0445927c9a57', 'volume_name': 'volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57', 'volume_size': 1, 'image_id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7ff1e5c089804fe694a8f7d1bf0a7374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'created_at': datetime.datetime(2026, 9, 9, 16, 5, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 5, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a72b240-52fe-48c1-bcf3-08faddb8bb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a72b240-52fe-48c1-bcf3-08faddb8bb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a9b5a0-0607-487f-8f49-ed231765cbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:09 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Volume 6afe203f-c3c9-41c4-a5d6-0445927c9a57: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57', 'volume_size': 1, 'image_id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7ff1e5c089804fe694a8f7d1bf0a7374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'created_at': datetime.datetime(2026, 9, 9, 16, 5, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 5, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 18:19:09 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Trying to clone 6afe203f-c3c9-41c4-a5d6-0445927c9a57 from image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}]). {{(pid=87639) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 18:19:10 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_r4cs9ih4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 18:19:10 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Image download 20.69 MB at 20.69 MB/s Sep 09 18:19:10 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e82f7c6-c80b-4e0f-a5ae-237aba769c18]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_r4cs9ih4devstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:10 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_r4cs9ih4devstack@QuobyteHD Sep 09 18:19:10 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:10 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_r4cs9ih4devstack@QuobyteHD" returned: 0 in 0.422s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:10 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Temporary image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 is fetched for user 8f45417d035947d9b064c8849423fdb3. {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 18:19:10 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb97627-e767-47b7-831f-3fa3b81a571d]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_r4cs9ih4devstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:10 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_r4cs9ih4devstack@QuobyteHD Sep 09 18:19:10 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:11 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_r4cs9ih4devstack@QuobyteHD" returned: 0 in 0.455s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-810136149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6afe203f-c3c9-41c4-a5d6-0445927c9a57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bcb7b36c6242f8b3be0a915a296f98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:19:09Z,use_quota=True,user_id='8f45417d035947d9b064c8849423fdb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:19:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Creating volume 6afe203f-c3c9-41c4-a5d6-0445927c9a57 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:19:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:19:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:19:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:19:11 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:19:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:11 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57 1073741824 Sep 09 18:19:11 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:11 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57 1073741824" returned: 0 in 0.593s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:12 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57 Sep 09 18:19:12 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:12 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57" returned: 0 in 0.502s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:19:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:12 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Attempting download of 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 ((None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}])) to volume 6afe203f-c3c9-41c4-a5d6-0445927c9a57. {{(pid=87639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 18:19:12 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[22da59a5-69e5-4150-9eaf-15461b169637]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_x0fvex3q {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:12 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_x0fvex3q Sep 09 18:19:12 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:13 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_x0fvex3q" returned: 0 in 0.462s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_x0fvex3q {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:13 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_x0fvex3q Sep 09 18:19:13 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:13 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_x0fvex3q" returned: 1 in 0.496s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_x0fvex3q' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:19:13 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f1e3f8-5ebd-4e45-8dc2-5583f003caf1]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_r4cs9ih4devstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:13 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_r4cs9ih4devstack@QuobyteHD Sep 09 18:19:13 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:14 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_r4cs9ih4devstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:14 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 was qcow2, converting to qcow2 {{(pid=87639) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 18:19:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_r4cs9ih4devstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:14 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_r4cs9ih4devstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57 Sep 09 18:19:14 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:16 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_r4cs9ih4devstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57" returned: 0 in 2.563s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:16 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_r4cs9ih4devstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57 {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:19:16 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Converted 112.00 MB image at 43.66 MB/s Sep 09 18:19:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:16 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57 1G Sep 09 18:19:16 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:17 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57 1G" returned: 0 in 0.514s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:17 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Downloaded image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 ((None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}])) to volume 6afe203f-c3c9-41c4-a5d6-0445927c9a57 successfully. {{(pid=87639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 18:19:17 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Temporary image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 for user 8f45417d035947d9b064c8849423fdb3 is deleted. {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 18:19:17 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Marking volume 6afe203f-c3c9-41c4-a5d6-0445927c9a57 as bootable. {{(pid=87639) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 18:19:17 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Copying metadata from image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 to 6afe203f-c3c9-41c4-a5d6-0445927c9a57. {{(pid=87639) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 18:19:17 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Creating volume glance metadata for volume 6afe203f-c3c9-41c4-a5d6-0445927c9a57 backed by image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87639) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 18:19:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a9b5a0-0607-487f-8f49-ed231765cbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57', 'volume_size': 1, 'image_id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7ff1e5c089804fe694a8f7d1bf0a7374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'created_at': datetime.datetime(2026, 9, 9, 16, 5, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 5, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab87eb2-27b8-4771-bdfc-7aecc1f64f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:17 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Volume volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57 (6afe203f-c3c9-41c4-a5d6-0445927c9a57): created successfully Sep 09 18:19:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ab87eb2-27b8-4771-bdfc-7aecc1f64f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Flow 'volume_create_manager' (11069181-a187-4c03-a389-2fee8b0337ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:19:17 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-7067a279-f203-4b68-b999-31639c071d7b tempest-VolumesImageMetadata-854240465 None] Created volume successfully. Sep 09 18:19:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3db16088-aa87-4062-8dca-a165d6777a74 tempest-VolumesImageMetadata-854240465 None] Acquiring lock "cinder-6afe203f-c3c9-41c4-a5d6-0445927c9a57-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3db16088-aa87-4062-8dca-a165d6777a74 tempest-VolumesImageMetadata-854240465 None] Lock "cinder-6afe203f-c3c9-41c4-a5d6-0445927c9a57-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3db16088-aa87-4062-8dca-a165d6777a74 tempest-VolumesImageMetadata-854240465 None] Acquiring lock "cinder-quobyte-6afe203f-c3c9-41c4-a5d6-0445927c9a57" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3db16088-aa87-4062-8dca-a165d6777a74 tempest-VolumesImageMetadata-854240465 None] Lock "cinder-quobyte-6afe203f-c3c9-41c4-a5d6-0445927c9a57" acquired by "delete_volume" :: waited 0.027s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:19 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f84e7c-1299-4142-b03d-18c83bb9fe36]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3db16088-aa87-4062-8dca-a165d6777a74 tempest-VolumesImageMetadata-854240465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:19 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57 Sep 09 18:19:19 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:19 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3db16088-aa87-4062-8dca-a165d6777a74 tempest-VolumesImageMetadata-854240465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57" returned: 0 in 0.519s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3db16088-aa87-4062-8dca-a165d6777a74 tempest-VolumesImageMetadata-854240465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:19 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57 Sep 09 18:19:19 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:20 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3db16088-aa87-4062-8dca-a165d6777a74 tempest-VolumesImageMetadata-854240465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6afe203f-c3c9-41c4-a5d6-0445927c9a57" returned: 0 in 0.479s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:20 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3db16088-aa87-4062-8dca-a165d6777a74 tempest-VolumesImageMetadata-854240465 None] Lock "cinder-quobyte-6afe203f-c3c9-41c4-a5d6-0445927c9a57" released by "delete_volume" :: held 1.073s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:20 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-3db16088-aa87-4062-8dca-a165d6777a74 tempest-VolumesImageMetadata-854240465 None] Created reservations ['632680bf-fce3-430f-bfa5-d9bf7adacf80', '64f0ffb4-068b-432f-8763-5cf1d0ca2806', '105cb0c6-cef6-4c27-865f-7c1c95f650c3', '1f4b993c-3470-47d8-a262-2a2a57e78c4e'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:19:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3db16088-aa87-4062-8dca-a165d6777a74 tempest-VolumesImageMetadata-854240465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3db16088-aa87-4062-8dca-a165d6777a74 tempest-VolumesImageMetadata-854240465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3db16088-aa87-4062-8dca-a165d6777a74 tempest-VolumesImageMetadata-854240465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:19:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3db16088-aa87-4062-8dca-a165d6777a74 tempest-VolumesImageMetadata-854240465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:19:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3db16088-aa87-4062-8dca-a165d6777a74 tempest-VolumesImageMetadata-854240465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3db16088-aa87-4062-8dca-a165d6777a74 tempest-VolumesImageMetadata-854240465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:20 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:19:20 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:20 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3db16088-aa87-4062-8dca-a165d6777a74 tempest-VolumesImageMetadata-854240465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.350s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:20 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-3db16088-aa87-4062-8dca-a165d6777a74 tempest-VolumesImageMetadata-854240465 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:19:20 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-3db16088-aa87-4062-8dca-a165d6777a74 tempest-VolumesImageMetadata-854240465 None] Deleted volume successfully. Sep 09 18:19:20 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3db16088-aa87-4062-8dca-a165d6777a74 tempest-VolumesImageMetadata-854240465 None] Lock "cinder-6afe203f-c3c9-41c4-a5d6-0445927c9a57-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:21 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:19:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Flow 'volume_create_manager' (102f38ad-a78e-42bf-a8ab-1b129ee62181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:19:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ad5ee0-7b60-4e35-968b-53c4994ebd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99ad5ee0-7b60-4e35-968b-53c4994ebd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-974180269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f69172-9e4b-45e3-867b-16051676ceaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba163d2dee204ebab16ecdbfff9c8913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:19:21Z,use_quota=True,user_id='97af5168b8974f4882c2f0981680df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac7215c-8747-426c-a417-57697954f733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac7215c-8747-426c-a417-57697954f733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d362bc-8f72-4523-badc-96771cbe40eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d362bc-8f72-4523-badc-96771cbe40eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6f69172-9e4b-45e3-867b-16051676ceaf', 'volume_name': 'volume-b6f69172-9e4b-45e3-867b-16051676ceaf', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a11880-8ac9-489c-ac40-9264e0c9cda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a11880-8ac9-489c-ac40-9264e0c9cda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c6c3bc-76c1-416f-b4b6-1660466a8d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:21 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Volume b6f69172-9e4b-45e3-867b-16051676ceaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6f69172-9e4b-45e3-867b-16051676ceaf', 'volume_size': 1} Sep 09 18:19:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-974180269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f69172-9e4b-45e3-867b-16051676ceaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba163d2dee204ebab16ecdbfff9c8913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:19:21Z,use_quota=True,user_id='97af5168b8974f4882c2f0981680df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:19:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Creating volume b6f69172-9e4b-45e3-867b-16051676ceaf {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:19:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:19:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:19:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:19:21 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:19:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:21 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf 1073741824 Sep 09 18:19:21 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:22 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf 1073741824" returned: 0 in 0.721s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:22 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf Sep 09 18:19:22 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:22 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf" returned: 0 in 0.422s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:19:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39c6c3bc-76c1-416f-b4b6-1660466a8d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6f69172-9e4b-45e3-867b-16051676ceaf', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b991cb-0d53-4060-879c-09b7c7f8f2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:22 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Volume volume-b6f69172-9e4b-45e3-867b-16051676ceaf (b6f69172-9e4b-45e3-867b-16051676ceaf): created successfully Sep 09 18:19:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b991cb-0d53-4060-879c-09b7c7f8f2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Flow 'volume_create_manager' (102f38ad-a78e-42bf-a8ab-1b129ee62181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:19:22 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ec83007c-4891-4546-a233-e032aba79c1e tempest-VolumesSnapshotTestJSON-819713234 None] Created volume successfully. Sep 09 18:19:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-aa0f492f-4a0b-4974-a9a7-869ac9b457ae tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-aa0f492f-4a0b-4974-a9a7-869ac9b457ae tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-aa0f492f-4a0b-4974-a9a7-869ac9b457ae tempest-VolumesSnapshotTestJSON-819713234 None] Creating offline snapshot 0ab5206e-fa21-4307-ba21-88135384a0b2 of volume b6f69172-9e4b-45e3-867b-16051676ceaf {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:19:24 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13a69f2-52d6-45e7-a74e-6e384b2e089d]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa0f492f-4a0b-4974-a9a7-869ac9b457ae tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:25 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf Sep 09 18:19:25 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:25 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa0f492f-4a0b-4974-a9a7-869ac9b457ae tempest-VolumesSnapshotTestJSON-819713234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf" returned: 0 in 0.754s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa0f492f-4a0b-4974-a9a7-869ac9b457ae tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.0ab5206e-fa21-4307-ba21-88135384a0b2 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:25 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.0ab5206e-fa21-4307-ba21-88135384a0b2 1G Sep 09 18:19:25 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:26 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:19:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Flow 'volume_create_manager' (a050af33-5330-4e22-b1fc-7005e3104a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:19:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0062a38a-8e5b-4876-868a-de090594824a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:26 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0062a38a-8e5b-4876-868a-de090594824a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1161704387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5089d3b-4643-4c67-bacc-e4e1d904f7eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d599822cfe7448559ea157cce6a12f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:19:26Z,use_quota=True,user_id='59dd1d6e70194fc7852e125ee7c8f105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48483845-5bd8-4d3e-b47b-a3f773e2ecbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48483845-5bd8-4d3e-b47b-a3f773e2ecbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e75747-be8e-41b9-9513-95ada7c00ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e75747-be8e-41b9-9513-95ada7c00ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5089d3b-4643-4c67-bacc-e4e1d904f7eb', 'volume_name': 'volume-f5089d3b-4643-4c67-bacc-e4e1d904f7eb', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a64f063-e852-40f0-bd8f-0c1b9fc76163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a64f063-e852-40f0-bd8f-0c1b9fc76163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2b7b2f-99ba-4d3b-8e63-05a0dffacc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:26 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Volume f5089d3b-4643-4c67-bacc-e4e1d904f7eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5089d3b-4643-4c67-bacc-e4e1d904f7eb', 'volume_size': 1} Sep 09 18:19:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa0f492f-4a0b-4974-a9a7-869ac9b457ae tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.0ab5206e-fa21-4307-ba21-88135384a0b2 1G" returned: 0 in 0.716s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa0f492f-4a0b-4974-a9a7-869ac9b457ae tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f69172-9e4b-45e3-867b-16051676ceaf -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.0ab5206e-fa21-4307-ba21-88135384a0b2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:26 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f69172-9e4b-45e3-867b-16051676ceaf -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.0ab5206e-fa21-4307-ba21-88135384a0b2 Sep 09 18:19:26 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:26 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa0f492f-4a0b-4974-a9a7-869ac9b457ae tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6f69172-9e4b-45e3-867b-16051676ceaf -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.0ab5206e-fa21-4307-ba21-88135384a0b2" returned: 0 in 0.351s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:26 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-aa0f492f-4a0b-4974-a9a7-869ac9b457ae tempest-VolumesSnapshotTestJSON-819713234 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.0ab5206e-fa21-4307-ba21-88135384a0b2 is being set with open permissions: ugo+rw Sep 09 18:19:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa0f492f-4a0b-4974-a9a7-869ac9b457ae tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.0ab5206e-fa21-4307-ba21-88135384a0b2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:26 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.0ab5206e-fa21-4307-ba21-88135384a0b2 Sep 09 18:19:26 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:26 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa0f492f-4a0b-4974-a9a7-869ac9b457ae tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.0ab5206e-fa21-4307-ba21-88135384a0b2" returned: 0 in 0.329s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa0f492f-4a0b-4974-a9a7-869ac9b457ae tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:27 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.info Sep 09 18:19:27 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:27 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa0f492f-4a0b-4974-a9a7-869ac9b457ae tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.info" returned: 0 in 0.351s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:27 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-aa0f492f-4a0b-4974-a9a7-869ac9b457ae tempest-VolumesSnapshotTestJSON-819713234 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.info is being set with open permissions: ugo+rw Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa0f492f-4a0b-4974-a9a7-869ac9b457ae tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:27 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.info Sep 09 18:19:27 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:27 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa0f492f-4a0b-4974-a9a7-869ac9b457ae tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.info" returned: 0 in 0.281s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-aa0f492f-4a0b-4974-a9a7-869ac9b457ae tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.955s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.409s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1161704387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5089d3b-4643-4c67-bacc-e4e1d904f7eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d599822cfe7448559ea157cce6a12f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:19:26Z,use_quota=True,user_id='59dd1d6e70194fc7852e125ee7c8f105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Creating volume f5089d3b-4643-4c67-bacc-e4e1d904f7eb {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:19:27 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f5089d3b-4643-4c67-bacc-e4e1d904f7eb 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:27 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f5089d3b-4643-4c67-bacc-e4e1d904f7eb 1073741824 Sep 09 18:19:27 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:27 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-aa0f492f-4a0b-4974-a9a7-869ac9b457ae tempest-VolumesSnapshotTestJSON-819713234 None] Create snapshot completed successfully Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Flow 'volume_create_manager' (150e41dc-d59b-49ec-bc85-6fede4157dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a96c45-d14e-40a7-8f61-10b135c0037c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a96c45-d14e-40a7-8f61-10b135c0037c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-35520085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3fb0fc4-84d3-4eff-a343-665cd76e5fdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425a841e69e7413aba2949fd572988de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:19:28Z,use_quota=True,user_id='3176977c8d9546a7841c9a3dd496348b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34f0bee-fd10-488e-b033-df7c84b06ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34f0bee-fd10-488e-b033-df7c84b06ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30b26ed-8885-417b-b372-524b4436d5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30b26ed-8885-417b-b372-524b4436d5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3fb0fc4-84d3-4eff-a343-665cd76e5fdb', 'volume_name': 'volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407a0aad-b23c-4d52-ae56-82e147be9b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (407a0aad-b23c-4d52-ae56-82e147be9b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c23e957-42ed-4a6b-bfd0-7d171870bdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:27 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Volume b3fb0fc4-84d3-4eff-a343-665cd76e5fdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb', 'volume_size': 1} Sep 09 18:19:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:28 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f5089d3b-4643-4c67-bacc-e4e1d904f7eb 1073741824" returned: 0 in 0.639s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f5089d3b-4643-4c67-bacc-e4e1d904f7eb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:28 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f5089d3b-4643-4c67-bacc-e4e1d904f7eb Sep 09 18:19:28 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:28 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f5089d3b-4643-4c67-bacc-e4e1d904f7eb" returned: 0 in 0.290s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:19:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.668s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-35520085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3fb0fc4-84d3-4eff-a343-665cd76e5fdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='425a841e69e7413aba2949fd572988de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:19:28Z,use_quota=True,user_id='3176977c8d9546a7841c9a3dd496348b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:19:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Creating volume b3fb0fc4-84d3-4eff-a343-665cd76e5fdb {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:19:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:19:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:19:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:19:28 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:19:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:28 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb 1073741824 Sep 09 18:19:28 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2b7b2f-99ba-4d3b-8e63-05a0dffacc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5089d3b-4643-4c67-bacc-e4e1d904f7eb', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8488f7a0-4ea0-44e0-8ea3-eb9555137e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:28 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Volume volume-f5089d3b-4643-4c67-bacc-e4e1d904f7eb (f5089d3b-4643-4c67-bacc-e4e1d904f7eb): created successfully Sep 09 18:19:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8488f7a0-4ea0-44e0-8ea3-eb9555137e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Flow 'volume_create_manager' (a050af33-5330-4e22-b1fc-7005e3104a70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:19:28 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-6397d220-538e-442a-b127-4094939c7b70 tempest-AbsoluteLimitsTests-482170329 None] Created volume successfully. Sep 09 18:19:28 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a4751a94-be2f-48c3-832c-b1cff0b6999a tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-0ab5206e-fa21-4307-ba21-88135384a0b2-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a4751a94-be2f-48c3-832c-b1cff0b6999a tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-0ab5206e-fa21-4307-ba21-88135384a0b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a4751a94-be2f-48c3-832c-b1cff0b6999a tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-quobyte-b6f69172-9e4b-45e3-867b-16051676ceaf" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a4751a94-be2f-48c3-832c-b1cff0b6999a tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-b6f69172-9e4b-45e3-867b-16051676ceaf" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a4751a94-be2f-48c3-832c-b1cff0b6999a tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-quobyte-0ab5206e-fa21-4307-ba21-88135384a0b2" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a4751a94-be2f-48c3-832c-b1cff0b6999a tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-0ab5206e-fa21-4307-ba21-88135384a0b2" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-a4751a94-be2f-48c3-832c-b1cff0b6999a tempest-VolumesSnapshotTestJSON-819713234 None] Deleting offline snapshot 0ab5206e-fa21-4307-ba21-88135384a0b2 of volume b6f69172-9e4b-45e3-867b-16051676ceaf {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-a4751a94-be2f-48c3-832c-b1cff0b6999a tempest-VolumesSnapshotTestJSON-819713234 None] snapshot_file for this snap is: volume-b6f69172-9e4b-45e3-867b-16051676ceaf.0ab5206e-fa21-4307-ba21-88135384a0b2 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18a3bd0-c330-4894-bf6a-994bff85bfff]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a4751a94-be2f-48c3-832c-b1cff0b6999a tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.0ab5206e-fa21-4307-ba21-88135384a0b2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:29 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.0ab5206e-fa21-4307-ba21-88135384a0b2 Sep 09 18:19:29 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:29 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb 1073741824" returned: 0 in 0.670s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:29 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb Sep 09 18:19:29 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:29 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a4751a94-be2f-48c3-832c-b1cff0b6999a tempest-VolumesSnapshotTestJSON-819713234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.0ab5206e-fa21-4307-ba21-88135384a0b2" returned: 0 in 0.489s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-a4751a94-be2f-48c3-832c-b1cff0b6999a tempest-VolumesSnapshotTestJSON-819713234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6f69172-9e4b-45e3-867b-16051676ceaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3208ae9a-58bc-42f8-8ad0-66cef45a5f94]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a4751a94-be2f-48c3-832c-b1cff0b6999a tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:29 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-46abab61-d030-49d8-b15f-ca88a4832f85 tempest-AbsoluteLimitsTests-482170329 None] Acquiring lock "cinder-f5089d3b-4643-4c67-bacc-e4e1d904f7eb-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb" returned: 0 in 0.350s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-46abab61-d030-49d8-b15f-ca88a4832f85 tempest-AbsoluteLimitsTests-482170329 None] Lock "cinder-f5089d3b-4643-4c67-bacc-e4e1d904f7eb-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c23e957-42ed-4a6b-bfd0-7d171870bdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc36dfa-823f-48b2-a279-277c4f8e6b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:29 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Volume volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb (b3fb0fc4-84d3-4eff-a343-665cd76e5fdb): created successfully Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc36dfa-823f-48b2-a279-277c4f8e6b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Flow 'volume_create_manager' (150e41dc-d59b-49ec-bc85-6fede4157dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:19:29 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-15e81ddb-54c7-4fb6-93b6-032950f9033f tempest-SnapshotMetadataTestJSON-1290105820 None] Created volume successfully. Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-46abab61-d030-49d8-b15f-ca88a4832f85 tempest-AbsoluteLimitsTests-482170329 None] Acquiring lock "cinder-quobyte-f5089d3b-4643-4c67-bacc-e4e1d904f7eb" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:29 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf Sep 09 18:19:29 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-46abab61-d030-49d8-b15f-ca88a4832f85 tempest-AbsoluteLimitsTests-482170329 None] Lock "cinder-quobyte-f5089d3b-4643-4c67-bacc-e4e1d904f7eb" acquired by "delete_volume" :: waited 0.024s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb9c4d3-e324-4d8a-97f0-c849cb84100c]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-46abab61-d030-49d8-b15f-ca88a4832f85 tempest-AbsoluteLimitsTests-482170329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f5089d3b-4643-4c67-bacc-e4e1d904f7eb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:30 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f5089d3b-4643-4c67-bacc-e4e1d904f7eb Sep 09 18:19:30 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:30 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a4751a94-be2f-48c3-832c-b1cff0b6999a tempest-VolumesSnapshotTestJSON-819713234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf" returned: 0 in 0.438s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a4751a94-be2f-48c3-832c-b1cff0b6999a tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.0ab5206e-fa21-4307-ba21-88135384a0b2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:30 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.0ab5206e-fa21-4307-ba21-88135384a0b2 Sep 09 18:19:30 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:30 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-46abab61-d030-49d8-b15f-ca88a4832f85 tempest-AbsoluteLimitsTests-482170329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f5089d3b-4643-4c67-bacc-e4e1d904f7eb" returned: 0 in 0.392s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-46abab61-d030-49d8-b15f-ca88a4832f85 tempest-AbsoluteLimitsTests-482170329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f5089d3b-4643-4c67-bacc-e4e1d904f7eb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:30 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f5089d3b-4643-4c67-bacc-e4e1d904f7eb Sep 09 18:19:30 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:30 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a4751a94-be2f-48c3-832c-b1cff0b6999a tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.0ab5206e-fa21-4307-ba21-88135384a0b2" returned: 0 in 0.330s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a4751a94-be2f-48c3-832c-b1cff0b6999a tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.0ab5206e-fa21-4307-ba21-88135384a0b2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:30 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.0ab5206e-fa21-4307-ba21-88135384a0b2 Sep 09 18:19:30 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:30 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-46abab61-d030-49d8-b15f-ca88a4832f85 tempest-AbsoluteLimitsTests-482170329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f5089d3b-4643-4c67-bacc-e4e1d904f7eb" returned: 0 in 0.254s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-46abab61-d030-49d8-b15f-ca88a4832f85 tempest-AbsoluteLimitsTests-482170329 None] Lock "cinder-quobyte-f5089d3b-4643-4c67-bacc-e4e1d904f7eb" released by "delete_volume" :: held 0.691s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:30 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-46abab61-d030-49d8-b15f-ca88a4832f85 tempest-AbsoluteLimitsTests-482170329 None] Created reservations ['ab7389a2-b789-4b34-83ae-061395c3e6ff', 'fa62d80a-6441-465a-8490-98d6bc11171b', '33a21d9f-29dc-4018-9b23-8dfcc0fdbc18', '9312c275-0ad3-4058-976c-ccec1fcddb36'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:19:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-46abab61-d030-49d8-b15f-ca88a4832f85 tempest-AbsoluteLimitsTests-482170329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-46abab61-d030-49d8-b15f-ca88a4832f85 tempest-AbsoluteLimitsTests-482170329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:30 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-46abab61-d030-49d8-b15f-ca88a4832f85 tempest-AbsoluteLimitsTests-482170329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:19:30 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-46abab61-d030-49d8-b15f-ca88a4832f85 tempest-AbsoluteLimitsTests-482170329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:19:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-46abab61-d030-49d8-b15f-ca88a4832f85 tempest-AbsoluteLimitsTests-482170329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-46abab61-d030-49d8-b15f-ca88a4832f85 tempest-AbsoluteLimitsTests-482170329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:30 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:19:30 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:30 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a4751a94-be2f-48c3-832c-b1cff0b6999a tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf.0ab5206e-fa21-4307-ba21-88135384a0b2" returned: 0 in 0.282s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a4751a94-be2f-48c3-832c-b1cff0b6999a tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-0ab5206e-fa21-4307-ba21-88135384a0b2" released by "_delete_snapshot" :: held 1.666s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a4751a94-be2f-48c3-832c-b1cff0b6999a tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-b6f69172-9e4b-45e3-867b-16051676ceaf" released by "delete_snapshot" :: held 1.709s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:30 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-a4751a94-be2f-48c3-832c-b1cff0b6999a tempest-VolumesSnapshotTestJSON-819713234 None] Created reservations ['d4e597cd-aa6c-417b-84d5-7c173a6f3ae2', 'be0db393-7e13-40a5-96e7-c14f45e4c3f0', '59f750a7-16af-49d3-ab68-492c165629aa', '1e854259-6d4e-4d23-a31a-4f1518b64894'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:19:30 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-a4751a94-be2f-48c3-832c-b1cff0b6999a tempest-VolumesSnapshotTestJSON-819713234 None] Delete snapshot completed successfully. Sep 09 18:19:30 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-46abab61-d030-49d8-b15f-ca88a4832f85 tempest-AbsoluteLimitsTests-482170329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.303s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:31 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-46abab61-d030-49d8-b15f-ca88a4832f85 tempest-AbsoluteLimitsTests-482170329 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:19:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a4751a94-be2f-48c3-832c-b1cff0b6999a tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-0ab5206e-fa21-4307-ba21-88135384a0b2-delete_snapshot" released by "delete_snapshot" :: held 2.002s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:31 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-46abab61-d030-49d8-b15f-ca88a4832f85 tempest-AbsoluteLimitsTests-482170329 None] Deleted volume successfully. Sep 09 18:19:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-46abab61-d030-49d8-b15f-ca88a4832f85 tempest-AbsoluteLimitsTests-482170329 None] Lock "cinder-f5089d3b-4643-4c67-bacc-e4e1d904f7eb-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a702d221-c106-4dee-a051-27667aa74c74 tempest-SnapshotMetadataTestJSON-1290105820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a702d221-c106-4dee-a051-27667aa74c74 tempest-SnapshotMetadataTestJSON-1290105820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-a702d221-c106-4dee-a051-27667aa74c74 tempest-SnapshotMetadataTestJSON-1290105820 None] Creating offline snapshot 7aef2dd7-44c6-456e-9016-c7df92c286c5 of volume b3fb0fc4-84d3-4eff-a343-665cd76e5fdb {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:19:31 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2377a7-64cb-40e1-865d-0ecbd12c6ff2]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a702d221-c106-4dee-a051-27667aa74c74 tempest-SnapshotMetadataTestJSON-1290105820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:31 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb Sep 09 18:19:31 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:31 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a702d221-c106-4dee-a051-27667aa74c74 tempest-SnapshotMetadataTestJSON-1290105820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb" returned: 0 in 0.464s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a702d221-c106-4dee-a051-27667aa74c74 tempest-SnapshotMetadataTestJSON-1290105820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.7aef2dd7-44c6-456e-9016-c7df92c286c5 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:31 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.7aef2dd7-44c6-456e-9016-c7df92c286c5 1G Sep 09 18:19:31 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:32 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:19:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Flow 'volume_create_manager' (1a130bdc-5d70-450d-9261-89066d53ae33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:19:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e0abd09-8271-416a-812c-243e69c2fc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e0abd09-8271-416a-812c-243e69c2fc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-286667454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a0017c-1a49-4a88-a074-671a526fa1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba163d2dee204ebab16ecdbfff9c8913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:19:32Z,use_quota=True,user_id='97af5168b8974f4882c2f0981680df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b7974a7-1a83-46ff-9137-92b6607b7577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b7974a7-1a83-46ff-9137-92b6607b7577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eaac378-8b14-42b5-8057-aa1a0e71bfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eaac378-8b14-42b5-8057-aa1a0e71bfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1a0017c-1a49-4a88-a074-671a526fa1d2', 'volume_name': 'volume-e1a0017c-1a49-4a88-a074-671a526fa1d2', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1689d643-a012-4164-8958-da7ff0030cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1689d643-a012-4164-8958-da7ff0030cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee368e45-158d-4e16-b347-733c404eda33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:32 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Volume e1a0017c-1a49-4a88-a074-671a526fa1d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1a0017c-1a49-4a88-a074-671a526fa1d2', 'volume_size': 1} Sep 09 18:19:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:32 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a702d221-c106-4dee-a051-27667aa74c74 tempest-SnapshotMetadataTestJSON-1290105820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.7aef2dd7-44c6-456e-9016-c7df92c286c5 1G" returned: 0 in 0.525s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a702d221-c106-4dee-a051-27667aa74c74 tempest-SnapshotMetadataTestJSON-1290105820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.7aef2dd7-44c6-456e-9016-c7df92c286c5 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:32 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.7aef2dd7-44c6-456e-9016-c7df92c286c5 Sep 09 18:19:32 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:32 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a702d221-c106-4dee-a051-27667aa74c74 tempest-SnapshotMetadataTestJSON-1290105820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.7aef2dd7-44c6-456e-9016-c7df92c286c5" returned: 0 in 0.334s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:32 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-a702d221-c106-4dee-a051-27667aa74c74 tempest-SnapshotMetadataTestJSON-1290105820 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.7aef2dd7-44c6-456e-9016-c7df92c286c5 is being set with open permissions: ugo+rw Sep 09 18:19:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a702d221-c106-4dee-a051-27667aa74c74 tempest-SnapshotMetadataTestJSON-1290105820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.7aef2dd7-44c6-456e-9016-c7df92c286c5 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:32 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.7aef2dd7-44c6-456e-9016-c7df92c286c5 Sep 09 18:19:32 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:33 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a702d221-c106-4dee-a051-27667aa74c74 tempest-SnapshotMetadataTestJSON-1290105820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.7aef2dd7-44c6-456e-9016-c7df92c286c5" returned: 0 in 0.270s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a702d221-c106-4dee-a051-27667aa74c74 tempest-SnapshotMetadataTestJSON-1290105820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:33 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.info Sep 09 18:19:33 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:33 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a702d221-c106-4dee-a051-27667aa74c74 tempest-SnapshotMetadataTestJSON-1290105820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.info" returned: 0 in 0.280s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:33 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-a702d221-c106-4dee-a051-27667aa74c74 tempest-SnapshotMetadataTestJSON-1290105820 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.info is being set with open permissions: ugo+rw Sep 09 18:19:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a702d221-c106-4dee-a051-27667aa74c74 tempest-SnapshotMetadataTestJSON-1290105820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:33 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.info Sep 09 18:19:33 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:33 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a702d221-c106-4dee-a051-27667aa74c74 tempest-SnapshotMetadataTestJSON-1290105820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.info" returned: 0 in 0.273s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a702d221-c106-4dee-a051-27667aa74c74 tempest-SnapshotMetadataTestJSON-1290105820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.276s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.538s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-286667454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a0017c-1a49-4a88-a074-671a526fa1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba163d2dee204ebab16ecdbfff9c8913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:19:32Z,use_quota=True,user_id='97af5168b8974f4882c2f0981680df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:19:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Creating volume e1a0017c-1a49-4a88-a074-671a526fa1d2 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:19:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:19:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:19:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:19:33 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:19:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:33 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 1073741824 Sep 09 18:19:33 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:33 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-a702d221-c106-4dee-a051-27667aa74c74 tempest-SnapshotMetadataTestJSON-1290105820 None] Create snapshot completed successfully Sep 09 18:19:34 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 1073741824" returned: 0 in 0.483s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:34 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 Sep 09 18:19:34 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:34 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2" returned: 0 in 0.254s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:19:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee368e45-158d-4e16-b347-733c404eda33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1a0017c-1a49-4a88-a074-671a526fa1d2', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5349366f-c110-4b0a-a7f1-273a72509a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:34 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Volume volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 (e1a0017c-1a49-4a88-a074-671a526fa1d2): created successfully Sep 09 18:19:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5349366f-c110-4b0a-a7f1-273a72509a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Flow 'volume_create_manager' (1a130bdc-5d70-450d-9261-89066d53ae33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:19:34 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-27371013-e86d-477d-af33-224b16925202 tempest-VolumesSnapshotTestJSON-819713234 None] Created volume successfully. Sep 09 18:19:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4a43da39-a8c3-4bfb-be52-5403691d3b1c tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4a43da39-a8c3-4bfb-be52-5403691d3b1c tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-4a43da39-a8c3-4bfb-be52-5403691d3b1c tempest-VolumesSnapshotTestJSON-819713234 None] Creating offline snapshot eaa37f26-4f79-46cb-8f89-fae1851d1f6d of volume e1a0017c-1a49-4a88-a074-671a526fa1d2 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:19:35 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bd8bc6-4757-4031-acb3-ed715a2473b1]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a43da39-a8c3-4bfb-be52-5403691d3b1c tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:35 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 Sep 09 18:19:35 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dd5962ab-8503-478c-b2d6-8e0dbc2ddefc tempest-SnapshotMetadataTestJSON-1290105820 None] Acquiring lock "cinder-7aef2dd7-44c6-456e-9016-c7df92c286c5-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dd5962ab-8503-478c-b2d6-8e0dbc2ddefc tempest-SnapshotMetadataTestJSON-1290105820 None] Lock "cinder-7aef2dd7-44c6-456e-9016-c7df92c286c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dd5962ab-8503-478c-b2d6-8e0dbc2ddefc tempest-SnapshotMetadataTestJSON-1290105820 None] Acquiring lock "cinder-quobyte-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dd5962ab-8503-478c-b2d6-8e0dbc2ddefc tempest-SnapshotMetadataTestJSON-1290105820 None] Lock "cinder-quobyte-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dd5962ab-8503-478c-b2d6-8e0dbc2ddefc tempest-SnapshotMetadataTestJSON-1290105820 None] Acquiring lock "cinder-quobyte-7aef2dd7-44c6-456e-9016-c7df92c286c5" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dd5962ab-8503-478c-b2d6-8e0dbc2ddefc tempest-SnapshotMetadataTestJSON-1290105820 None] Lock "cinder-quobyte-7aef2dd7-44c6-456e-9016-c7df92c286c5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-dd5962ab-8503-478c-b2d6-8e0dbc2ddefc tempest-SnapshotMetadataTestJSON-1290105820 None] Deleting offline snapshot 7aef2dd7-44c6-456e-9016-c7df92c286c5 of volume b3fb0fc4-84d3-4eff-a343-665cd76e5fdb {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:19:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-dd5962ab-8503-478c-b2d6-8e0dbc2ddefc tempest-SnapshotMetadataTestJSON-1290105820 None] snapshot_file for this snap is: volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.7aef2dd7-44c6-456e-9016-c7df92c286c5 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:19:35 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b5964c-a7b0-4268-b835-65ce4ae93f2f]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dd5962ab-8503-478c-b2d6-8e0dbc2ddefc tempest-SnapshotMetadataTestJSON-1290105820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.7aef2dd7-44c6-456e-9016-c7df92c286c5 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:35 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.7aef2dd7-44c6-456e-9016-c7df92c286c5 Sep 09 18:19:35 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:36 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a43da39-a8c3-4bfb-be52-5403691d3b1c tempest-VolumesSnapshotTestJSON-819713234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2" returned: 0 in 0.539s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a43da39-a8c3-4bfb-be52-5403691d3b1c tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:36 devstack sudo[97578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d 1G Sep 09 18:19:36 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:36 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dd5962ab-8503-478c-b2d6-8e0dbc2ddefc tempest-SnapshotMetadataTestJSON-1290105820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.7aef2dd7-44c6-456e-9016-c7df92c286c5" returned: 0 in 0.479s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:36 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-dd5962ab-8503-478c-b2d6-8e0dbc2ddefc tempest-SnapshotMetadataTestJSON-1290105820 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:19:36 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[866c6d62-9dc4-4a57-8299-cc273624bd37]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dd5962ab-8503-478c-b2d6-8e0dbc2ddefc tempest-SnapshotMetadataTestJSON-1290105820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:36 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb Sep 09 18:19:36 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:36 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a43da39-a8c3-4bfb-be52-5403691d3b1c tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d 1G" returned: 0 in 0.490s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a43da39-a8c3-4bfb-be52-5403691d3b1c tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:36 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d Sep 09 18:19:36 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:36 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dd5962ab-8503-478c-b2d6-8e0dbc2ddefc tempest-SnapshotMetadataTestJSON-1290105820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb" returned: 0 in 0.503s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dd5962ab-8503-478c-b2d6-8e0dbc2ddefc tempest-SnapshotMetadataTestJSON-1290105820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.7aef2dd7-44c6-456e-9016-c7df92c286c5 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:36 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.7aef2dd7-44c6-456e-9016-c7df92c286c5 Sep 09 18:19:36 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:36 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a43da39-a8c3-4bfb-be52-5403691d3b1c tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d" returned: 0 in 0.482s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:36 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-4a43da39-a8c3-4bfb-be52-5403691d3b1c tempest-VolumesSnapshotTestJSON-819713234 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d is being set with open permissions: ugo+rw Sep 09 18:19:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a43da39-a8c3-4bfb-be52-5403691d3b1c tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:37 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d Sep 09 18:19:37 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Flow 'volume_create_manager' (2a796583-1139-40b2-9676-0a2a6bf5c43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9feff67f-80d3-49a4-b57c-ed1d5f686153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9feff67f-80d3-49a4-b57c-ed1d5f686153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-297954514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ba51338-a388-409e-b794-4eddf6dd4790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140a62197fb14518a6d71311e2b9574b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:19:37Z,use_quota=True,user_id='2fc56cafe02d480b99c7144e58f48e89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb94406f-90b6-41fe-bfcb-abadf9e6b048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb94406f-90b6-41fe-bfcb-abadf9e6b048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed1adfb6-e1cb-499e-a108-cccf2be0725b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed1adfb6-e1cb-499e-a108-cccf2be0725b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ba51338-a388-409e-b794-4eddf6dd4790', 'volume_name': 'volume-7ba51338-a388-409e-b794-4eddf6dd4790', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a59e9502-11f3-4010-96ac-c2e3f0adc22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a59e9502-11f3-4010-96ac-c2e3f0adc22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cac52d5-88cd-4824-9829-fb55ffa3c737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:37 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Volume 7ba51338-a388-409e-b794-4eddf6dd4790: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ba51338-a388-409e-b794-4eddf6dd4790', 'volume_size': 1} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:37 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a43da39-a8c3-4bfb-be52-5403691d3b1c tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d" returned: 0 in 0.313s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a43da39-a8c3-4bfb-be52-5403691d3b1c tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:37 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.info Sep 09 18:19:37 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:37 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dd5962ab-8503-478c-b2d6-8e0dbc2ddefc tempest-SnapshotMetadataTestJSON-1290105820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.7aef2dd7-44c6-456e-9016-c7df92c286c5" returned: 0 in 0.530s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dd5962ab-8503-478c-b2d6-8e0dbc2ddefc tempest-SnapshotMetadataTestJSON-1290105820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.7aef2dd7-44c6-456e-9016-c7df92c286c5 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:37 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.7aef2dd7-44c6-456e-9016-c7df92c286c5 Sep 09 18:19:37 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:37 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a43da39-a8c3-4bfb-be52-5403691d3b1c tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.info" returned: 0 in 0.265s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:37 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-4a43da39-a8c3-4bfb-be52-5403691d3b1c tempest-VolumesSnapshotTestJSON-819713234 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.info is being set with open permissions: ugo+rw Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a43da39-a8c3-4bfb-be52-5403691d3b1c tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:37 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.info Sep 09 18:19:37 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:37 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dd5962ab-8503-478c-b2d6-8e0dbc2ddefc tempest-SnapshotMetadataTestJSON-1290105820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb.7aef2dd7-44c6-456e-9016-c7df92c286c5" returned: 0 in 0.266s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dd5962ab-8503-478c-b2d6-8e0dbc2ddefc tempest-SnapshotMetadataTestJSON-1290105820 None] Lock "cinder-quobyte-7aef2dd7-44c6-456e-9016-c7df92c286c5" released by "_delete_snapshot" :: held 1.901s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dd5962ab-8503-478c-b2d6-8e0dbc2ddefc tempest-SnapshotMetadataTestJSON-1290105820 None] Lock "cinder-quobyte-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb" released by "delete_snapshot" :: held 1.923s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-dd5962ab-8503-478c-b2d6-8e0dbc2ddefc tempest-SnapshotMetadataTestJSON-1290105820 None] Created reservations ['bc639736-aa19-4624-bdc3-335a0ba70599', '3f89780e-c466-4537-bd86-daae97c1d99f', '08fec2d6-95a2-4adc-a61c-2d0e70a7fed6', '3e8fe60e-785a-49bd-834f-606eed0e71cd'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:19:37 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-dd5962ab-8503-478c-b2d6-8e0dbc2ddefc tempest-SnapshotMetadataTestJSON-1290105820 None] Delete snapshot completed successfully. Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dd5962ab-8503-478c-b2d6-8e0dbc2ddefc tempest-SnapshotMetadataTestJSON-1290105820 None] Lock "cinder-7aef2dd7-44c6-456e-9016-c7df92c286c5-delete_snapshot" released by "delete_snapshot" :: held 2.067s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:37 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a43da39-a8c3-4bfb-be52-5403691d3b1c tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.info" returned: 0 in 0.261s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4a43da39-a8c3-4bfb-be52-5403691d3b1c tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.475s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.754s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-297954514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ba51338-a388-409e-b794-4eddf6dd4790,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='140a62197fb14518a6d71311e2b9574b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:19:37Z,use_quota=True,user_id='2fc56cafe02d480b99c7144e58f48e89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Creating volume 7ba51338-a388-409e-b794-4eddf6dd4790 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:19:37 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ba51338-a388-409e-b794-4eddf6dd4790 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:37 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ba51338-a388-409e-b794-4eddf6dd4790 1073741824 Sep 09 18:19:37 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:37 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-4a43da39-a8c3-4bfb-be52-5403691d3b1c tempest-VolumesSnapshotTestJSON-819713234 None] Create snapshot completed successfully Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8919878b-45cd-4d69-b1ba-134ed2001fcc tempest-SnapshotMetadataTestJSON-1290105820 None] Acquiring lock "cinder-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8919878b-45cd-4d69-b1ba-134ed2001fcc tempest-SnapshotMetadataTestJSON-1290105820 None] Lock "cinder-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8919878b-45cd-4d69-b1ba-134ed2001fcc tempest-SnapshotMetadataTestJSON-1290105820 None] Acquiring lock "cinder-quobyte-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8919878b-45cd-4d69-b1ba-134ed2001fcc tempest-SnapshotMetadataTestJSON-1290105820 None] Lock "cinder-quobyte-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb" acquired by "delete_volume" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3921d50a-7f3b-48e0-b194-94e771f6ff75]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8919878b-45cd-4d69-b1ba-134ed2001fcc tempest-SnapshotMetadataTestJSON-1290105820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:38 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb Sep 09 18:19:38 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:38 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ba51338-a388-409e-b794-4eddf6dd4790 1073741824" returned: 0 in 0.460s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ba51338-a388-409e-b794-4eddf6dd4790 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:38 devstack sudo[97648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ba51338-a388-409e-b794-4eddf6dd4790 Sep 09 18:19:38 devstack sudo[97648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:38 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8919878b-45cd-4d69-b1ba-134ed2001fcc tempest-SnapshotMetadataTestJSON-1290105820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb" returned: 0 in 0.410s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8919878b-45cd-4d69-b1ba-134ed2001fcc tempest-SnapshotMetadataTestJSON-1290105820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:38 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb Sep 09 18:19:38 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:38 devstack sudo[97648]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ba51338-a388-409e-b794-4eddf6dd4790" returned: 0 in 0.274s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cac52d5-88cd-4824-9829-fb55ffa3c737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ba51338-a388-409e-b794-4eddf6dd4790', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29739fbf-be49-4dfb-8efe-13dab01ae8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:38 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Volume volume-7ba51338-a388-409e-b794-4eddf6dd4790 (7ba51338-a388-409e-b794-4eddf6dd4790): created successfully Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29739fbf-be49-4dfb-8efe-13dab01ae8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Flow 'volume_create_manager' (2a796583-1139-40b2-9676-0a2a6bf5c43e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:19:38 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-1769dbfe-4b04-4799-9816-2cddfdb64bcf tempest-VolumesMetadataTest-2020351758 None] Created volume successfully. Sep 09 18:19:38 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8919878b-45cd-4d69-b1ba-134ed2001fcc tempest-SnapshotMetadataTestJSON-1290105820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb" returned: 0 in 0.272s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8919878b-45cd-4d69-b1ba-134ed2001fcc tempest-SnapshotMetadataTestJSON-1290105820 None] Lock "cinder-quobyte-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb" released by "delete_volume" :: held 0.749s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-8919878b-45cd-4d69-b1ba-134ed2001fcc tempest-SnapshotMetadataTestJSON-1290105820 None] Created reservations ['637df008-6358-4b8c-827a-ed3adf92c9d3', '5f03b64a-8648-4e1e-a00f-721368cd7c65', '98167013-2c05-4746-8600-d42de0060042', 'c80fa6d2-786e-4109-9550-0348a21267c0'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8919878b-45cd-4d69-b1ba-134ed2001fcc tempest-SnapshotMetadataTestJSON-1290105820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8919878b-45cd-4d69-b1ba-134ed2001fcc tempest-SnapshotMetadataTestJSON-1290105820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8919878b-45cd-4d69-b1ba-134ed2001fcc tempest-SnapshotMetadataTestJSON-1290105820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8919878b-45cd-4d69-b1ba-134ed2001fcc tempest-SnapshotMetadataTestJSON-1290105820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8919878b-45cd-4d69-b1ba-134ed2001fcc tempest-SnapshotMetadataTestJSON-1290105820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8919878b-45cd-4d69-b1ba-134ed2001fcc tempest-SnapshotMetadataTestJSON-1290105820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:38 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:19:38 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Flow 'volume_create_manager' (020280aa-4688-4970-8f36-2632c40b97a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c796426f-a6c1-48ff-8891-aeb71b376e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c796426f-a6c1-48ff-8891-aeb71b376e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-873481351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=613c6f35-88a9-4eea-b148-b41badf58ce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba163d2dee204ebab16ecdbfff9c8913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:19:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=eaa37f26-4f79-46cb-8f89-fae1851d1f6d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:19:39Z,use_quota=True,user_id='97af5168b8974f4882c2f0981680df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5f1b3e-d126-478f-991e-59d7cd83ed5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5f1b3e-d126-478f-991e-59d7cd83ed5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec4e8e7-439e-4819-b522-83583d7abf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cec4e8e7-439e-4819-b522-83583d7abf7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '613c6f35-88a9-4eea-b148-b41badf58ce8', 'volume_name': 'volume-613c6f35-88a9-4eea-b148-b41badf58ce8', 'volume_size': 2, 'snapshot_id': 'eaa37f26-4f79-46cb-8f89-fae1851d1f6d'}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6918968d-f24d-4396-86b1-a2ffa4b6fdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6918968d-f24d-4396-86b1-a2ffa4b6fdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8a2bb5-d03f-46c1-8be9-f73ed86821cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:39 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Volume 613c6f35-88a9-4eea-b148-b41badf58ce8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-613c6f35-88a9-4eea-b148-b41badf58ce8', 'volume_size': 2, 'snapshot_id': 'eaa37f26-4f79-46cb-8f89-fae1851d1f6d'} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-quobyte-eaa37f26-4f79-46cb-8f89-fae1851d1f6d-613c6f35-88a9-4eea-b148-b41badf58ce8" by "_create_volume_from_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-eaa37f26-4f79-46cb-8f89-fae1851d1f6d-613c6f35-88a9-4eea-b148-b41badf58ce8" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Creating volume 613c6f35-88a9-4eea-b148-b41badf58ce8 from snapshot eaa37f26-4f79-46cb-8f89-fae1851d1f6d {{(pid=87639) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:39 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-quobyte-613c6f35-88a9-4eea-b148-b41badf58ce8" by "_copy_volume_from_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8919878b-45cd-4d69-b1ba-134ed2001fcc tempest-SnapshotMetadataTestJSON-1290105820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.432s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-8919878b-45cd-4d69-b1ba-134ed2001fcc tempest-SnapshotMetadataTestJSON-1290105820 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:19:39 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-8919878b-45cd-4d69-b1ba-134ed2001fcc tempest-SnapshotMetadataTestJSON-1290105820 None] Deleted volume successfully. Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-613c6f35-88a9-4eea-b148-b41badf58ce8" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] snapshot: eaa37f26-4f79-46cb-8f89-fae1851d1f6d, volume: 613c6f35-88a9-4eea-b148-b41badf58ce8, {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8919878b-45cd-4d69-b1ba-134ed2001fcc tempest-SnapshotMetadataTestJSON-1290105820 None] Lock "cinder-b3fb0fc4-84d3-4eff-a343-665cd76e5fdb-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c55860-abd2-41e1-b3ce-b631fed228e6]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:39 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d Sep 09 18:19:39 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:39 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d" returned: 0 in 0.411s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1a0017c-1a49-4a88-a074-671a526fa1d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f468d55-6d38-4418-938a-ef32aa821852]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:39 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 Sep 09 18:19:39 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:40 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-49ee3bb8-d96d-41eb-abbf-1f05af363baa tempest-VolumesMetadataTest-2020351758 None] Acquiring lock "cinder-7ba51338-a388-409e-b794-4eddf6dd4790-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:40 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-49ee3bb8-d96d-41eb-abbf-1f05af363baa tempest-VolumesMetadataTest-2020351758 None] Lock "cinder-7ba51338-a388-409e-b794-4eddf6dd4790-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:40 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-49ee3bb8-d96d-41eb-abbf-1f05af363baa tempest-VolumesMetadataTest-2020351758 None] Acquiring lock "cinder-quobyte-7ba51338-a388-409e-b794-4eddf6dd4790" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:40 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-49ee3bb8-d96d-41eb-abbf-1f05af363baa tempest-VolumesMetadataTest-2020351758 None] Lock "cinder-quobyte-7ba51338-a388-409e-b794-4eddf6dd4790" acquired by "delete_volume" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:40 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ba6f0b-f01d-433e-a850-95e5a2b0b46d]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-49ee3bb8-d96d-41eb-abbf-1f05af363baa tempest-VolumesMetadataTest-2020351758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ba51338-a388-409e-b794-4eddf6dd4790 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:40 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ba51338-a388-409e-b794-4eddf6dd4790 Sep 09 18:19:40 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:40 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2" returned: 0 in 0.457s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 18:19:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Creating direct copy from snapshot {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 18:19:40 devstack cinder-volume[87639]: DEBUG cinder.utils [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Path /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-613c6f35-88a9-4eea-b148-b41badf58ce8 not found in is_blk_device check {{(pid=87639) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 18:19:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-613c6f35-88a9-4eea-b148-b41badf58ce8 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:40 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-613c6f35-88a9-4eea-b148-b41badf58ce8 Sep 09 18:19:40 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:40 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-49ee3bb8-d96d-41eb-abbf-1f05af363baa tempest-VolumesMetadataTest-2020351758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ba51338-a388-409e-b794-4eddf6dd4790" returned: 0 in 0.399s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-49ee3bb8-d96d-41eb-abbf-1f05af363baa tempest-VolumesMetadataTest-2020351758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ba51338-a388-409e-b794-4eddf6dd4790 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:40 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ba51338-a388-409e-b794-4eddf6dd4790 Sep 09 18:19:40 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:40 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-49ee3bb8-d96d-41eb-abbf-1f05af363baa tempest-VolumesMetadataTest-2020351758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ba51338-a388-409e-b794-4eddf6dd4790" returned: 0 in 0.311s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:40 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-49ee3bb8-d96d-41eb-abbf-1f05af363baa tempest-VolumesMetadataTest-2020351758 None] Lock "cinder-quobyte-7ba51338-a388-409e-b794-4eddf6dd4790" released by "delete_volume" :: held 0.760s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:40 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-49ee3bb8-d96d-41eb-abbf-1f05af363baa tempest-VolumesMetadataTest-2020351758 None] Created reservations ['31c28d2a-10e3-4b7b-b5ad-d425e5984307', 'a1a1e5bb-a1d7-46c3-bef1-5775507f7e78', '0ea10b56-fc1e-4edc-a6a8-b29879b4f00f', 'edc7cc27-1313-4f61-b554-08eb3f8fe0b3'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:19:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-49ee3bb8-d96d-41eb-abbf-1f05af363baa tempest-VolumesMetadataTest-2020351758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-49ee3bb8-d96d-41eb-abbf-1f05af363baa tempest-VolumesMetadataTest-2020351758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:41 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-49ee3bb8-d96d-41eb-abbf-1f05af363baa tempest-VolumesMetadataTest-2020351758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:19:41 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-49ee3bb8-d96d-41eb-abbf-1f05af363baa tempest-VolumesMetadataTest-2020351758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:19:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-49ee3bb8-d96d-41eb-abbf-1f05af363baa tempest-VolumesMetadataTest-2020351758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-49ee3bb8-d96d-41eb-abbf-1f05af363baa tempest-VolumesMetadataTest-2020351758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:41 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:19:41 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:41 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-49ee3bb8-d96d-41eb-abbf-1f05af363baa tempest-VolumesMetadataTest-2020351758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.479s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:41 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-49ee3bb8-d96d-41eb-abbf-1f05af363baa tempest-VolumesMetadataTest-2020351758 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:19:41 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-49ee3bb8-d96d-41eb-abbf-1f05af363baa tempest-VolumesMetadataTest-2020351758 None] Deleted volume successfully. Sep 09 18:19:41 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-49ee3bb8-d96d-41eb-abbf-1f05af363baa tempest-VolumesMetadataTest-2020351758 None] Lock "cinder-7ba51338-a388-409e-b794-4eddf6dd4790-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:19:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:19:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:19:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:43 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:19:43 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:43 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.734s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:19:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:19:44 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 28 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:19:44 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:19:46 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-613c6f35-88a9-4eea-b148-b41badf58ce8" returned: 0 in 5.925s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:46 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Image conversion details: src /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2, size 1024.00 MB, duration 5.93 sec, destination /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-613c6f35-88a9-4eea-b148-b41badf58ce8 {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:19:46 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Converted 1024.00 MB image at 172.80 MB/s Sep 09 18:19:46 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-613c6f35-88a9-4eea-b148-b41badf58ce8 is being set with open permissions: ugo+rw Sep 09 18:19:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-613c6f35-88a9-4eea-b148-b41badf58ce8 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:46 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-613c6f35-88a9-4eea-b148-b41badf58ce8 Sep 09 18:19:46 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:46 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-613c6f35-88a9-4eea-b148-b41badf58ce8" returned: 0 in 0.296s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:46 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-613c6f35-88a9-4eea-b148-b41badf58ce8" released by "_copy_volume_from_snapshot" :: held 7.186s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:46 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-eaa37f26-4f79-46cb-8f89-fae1851d1f6d-613c6f35-88a9-4eea-b148-b41badf58ce8" released by "_create_volume_from_snapshot" :: held 7.279s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.305s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f8a2bb5-d03f-46c1-8be9-f73ed86821cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-613c6f35-88a9-4eea-b148-b41badf58ce8', 'volume_size': 2, 'snapshot_id': 'eaa37f26-4f79-46cb-8f89-fae1851d1f6d'}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb66820f-79fc-47b1-8cfd-5606456c1a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:46 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Volume volume-613c6f35-88a9-4eea-b148-b41badf58ce8 (613c6f35-88a9-4eea-b148-b41badf58ce8): created successfully Sep 09 18:19:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb66820f-79fc-47b1-8cfd-5606456c1a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Flow 'volume_create_manager' (020280aa-4688-4970-8f36-2632c40b97a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:19:46 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-3e46d554-63f1-4125-9760-2c4cadf8f4ef tempest-VolumesSnapshotTestJSON-819713234 None] Created volume successfully. Sep 09 18:19:47 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d00c667d-c832-4f14-8d48-993c1d59dfce tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-613c6f35-88a9-4eea-b148-b41badf58ce8-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:47 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d00c667d-c832-4f14-8d48-993c1d59dfce tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-613c6f35-88a9-4eea-b148-b41badf58ce8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:47 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d00c667d-c832-4f14-8d48-993c1d59dfce tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-quobyte-613c6f35-88a9-4eea-b148-b41badf58ce8" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:47 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d00c667d-c832-4f14-8d48-993c1d59dfce tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-613c6f35-88a9-4eea-b148-b41badf58ce8" acquired by "delete_volume" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:47 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4842f357-c337-4f1e-9a9c-16377804d02a]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d00c667d-c832-4f14-8d48-993c1d59dfce tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-613c6f35-88a9-4eea-b148-b41badf58ce8 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:47 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-613c6f35-88a9-4eea-b148-b41badf58ce8 Sep 09 18:19:47 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:47 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d00c667d-c832-4f14-8d48-993c1d59dfce tempest-VolumesSnapshotTestJSON-819713234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-613c6f35-88a9-4eea-b148-b41badf58ce8" returned: 0 in 0.438s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d00c667d-c832-4f14-8d48-993c1d59dfce tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-613c6f35-88a9-4eea-b148-b41badf58ce8 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:47 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-613c6f35-88a9-4eea-b148-b41badf58ce8 Sep 09 18:19:47 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:48 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d00c667d-c832-4f14-8d48-993c1d59dfce tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-613c6f35-88a9-4eea-b148-b41badf58ce8" returned: 0 in 0.327s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d00c667d-c832-4f14-8d48-993c1d59dfce tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-613c6f35-88a9-4eea-b148-b41badf58ce8" released by "delete_volume" :: held 0.817s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-d00c667d-c832-4f14-8d48-993c1d59dfce tempest-VolumesSnapshotTestJSON-819713234 None] Created reservations ['4d3f8123-1013-4288-b991-22127bf98576', 'ad80cc66-12ee-4ea6-9306-8ab4ee078133', '228a6b23-fd8d-463b-a509-bd7468acae30', 'd95f757c-2de6-4399-a33f-e36a753ec6bf'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d00c667d-c832-4f14-8d48-993c1d59dfce tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d00c667d-c832-4f14-8d48-993c1d59dfce tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d00c667d-c832-4f14-8d48-993c1d59dfce tempest-VolumesSnapshotTestJSON-819713234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d00c667d-c832-4f14-8d48-993c1d59dfce tempest-VolumesSnapshotTestJSON-819713234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d00c667d-c832-4f14-8d48-993c1d59dfce tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d00c667d-c832-4f14-8d48-993c1d59dfce tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:48 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:19:48 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c1574e04-564e-4fc7-a93d-2a1ac8829759 tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-eaa37f26-4f79-46cb-8f89-fae1851d1f6d-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c1574e04-564e-4fc7-a93d-2a1ac8829759 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-eaa37f26-4f79-46cb-8f89-fae1851d1f6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c1574e04-564e-4fc7-a93d-2a1ac8829759 tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-quobyte-e1a0017c-1a49-4a88-a074-671a526fa1d2" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c1574e04-564e-4fc7-a93d-2a1ac8829759 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-e1a0017c-1a49-4a88-a074-671a526fa1d2" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c1574e04-564e-4fc7-a93d-2a1ac8829759 tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-quobyte-eaa37f26-4f79-46cb-8f89-fae1851d1f6d" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c1574e04-564e-4fc7-a93d-2a1ac8829759 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-eaa37f26-4f79-46cb-8f89-fae1851d1f6d" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-c1574e04-564e-4fc7-a93d-2a1ac8829759 tempest-VolumesSnapshotTestJSON-819713234 None] Deleting offline snapshot eaa37f26-4f79-46cb-8f89-fae1851d1f6d of volume e1a0017c-1a49-4a88-a074-671a526fa1d2 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-c1574e04-564e-4fc7-a93d-2a1ac8829759 tempest-VolumesSnapshotTestJSON-819713234 None] snapshot_file for this snap is: volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4c7a40-0592-47d5-be96-0a883ccadd56]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c1574e04-564e-4fc7-a93d-2a1ac8829759 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Flow 'volume_create_manager' (1e129f4d-c95f-4996-a581-205fb6bcf2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (787f02e6-aafb-499e-8038-3645c0ba7700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:48 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d00c667d-c832-4f14-8d48-993c1d59dfce tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.493s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-d00c667d-c832-4f14-8d48-993c1d59dfce tempest-VolumesSnapshotTestJSON-819713234 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (787f02e6-aafb-499e-8038-3645c0ba7700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-971840591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a84a727-84f2-4f19-b13b-ef379b68c91c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659e26cec29d4ab99adec9eb58d93f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:19:49Z,use_quota=True,user_id='94c641d7c5e14e23b1cee39769e64447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d135bb7a-2cbb-44bc-90df-134b762f105a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d135bb7a-2cbb-44bc-90df-134b762f105a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:48 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d Sep 09 18:19:48 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a295215b-c0c0-4254-b704-40f200ee3d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a295215b-c0c0-4254-b704-40f200ee3d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a84a727-84f2-4f19-b13b-ef379b68c91c', 'volume_name': 'volume-5a84a727-84f2-4f19-b13b-ef379b68c91c', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c97d78e4-7619-422b-bea0-1b3135772101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c97d78e4-7619-422b-bea0-1b3135772101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ce32a8-ff5c-41d6-a35d-6e4766e40558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:48 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Volume 5a84a727-84f2-4f19-b13b-ef379b68c91c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a84a727-84f2-4f19-b13b-ef379b68c91c', 'volume_size': 1} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-971840591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a84a727-84f2-4f19-b13b-ef379b68c91c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659e26cec29d4ab99adec9eb58d93f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:19:49Z,use_quota=True,user_id='94c641d7c5e14e23b1cee39769e64447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Creating volume 5a84a727-84f2-4f19-b13b-ef379b68c91c {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:19:48 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5a84a727-84f2-4f19-b13b-ef379b68c91c 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:48 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d00c667d-c832-4f14-8d48-993c1d59dfce tempest-VolumesSnapshotTestJSON-819713234 None] Deleted volume successfully. Sep 09 18:19:48 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5a84a727-84f2-4f19-b13b-ef379b68c91c 1073741824 Sep 09 18:19:48 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d00c667d-c832-4f14-8d48-993c1d59dfce tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-613c6f35-88a9-4eea-b148-b41badf58ce8-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:49 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c1574e04-564e-4fc7-a93d-2a1ac8829759 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d" returned: 0 in 0.526s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:49 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-c1574e04-564e-4fc7-a93d-2a1ac8829759 tempest-VolumesSnapshotTestJSON-819713234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1a0017c-1a49-4a88-a074-671a526fa1d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:19:49 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7a0cd9-4671-44d9-b5a9-25c6188d143e]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c1574e04-564e-4fc7-a93d-2a1ac8829759 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:49 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 Sep 09 18:19:49 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:49 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5a84a727-84f2-4f19-b13b-ef379b68c91c 1073741824" returned: 0 in 0.622s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5a84a727-84f2-4f19-b13b-ef379b68c91c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:49 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5a84a727-84f2-4f19-b13b-ef379b68c91c Sep 09 18:19:49 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:49 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5a84a727-84f2-4f19-b13b-ef379b68c91c" returned: 0 in 0.331s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:49 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:19:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:49 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ce32a8-ff5c-41d6-a35d-6e4766e40558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a84a727-84f2-4f19-b13b-ef379b68c91c', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11fd320c-7a56-441f-8430-6f3da23b3e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c1574e04-564e-4fc7-a93d-2a1ac8829759 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2" returned: 0 in 0.678s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c1574e04-564e-4fc7-a93d-2a1ac8829759 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:49 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Volume volume-5a84a727-84f2-4f19-b13b-ef379b68c91c (5a84a727-84f2-4f19-b13b-ef379b68c91c): created successfully Sep 09 18:19:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11fd320c-7a56-441f-8430-6f3da23b3e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Flow 'volume_create_manager' (1e129f4d-c95f-4996-a581-205fb6bcf2ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:19:49 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d Sep 09 18:19:49 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:49 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-0970bff5-1103-49e6-9153-c46b21eb2e87 tempest-AttachVolumeTestJSON-1359511233 None] Created volume successfully. Sep 09 18:19:50 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c1574e04-564e-4fc7-a93d-2a1ac8829759 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d" returned: 0 in 0.442s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c1574e04-564e-4fc7-a93d-2a1ac8829759 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:50 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d Sep 09 18:19:50 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:50 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c1574e04-564e-4fc7-a93d-2a1ac8829759 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2.eaa37f26-4f79-46cb-8f89-fae1851d1f6d" returned: 0 in 0.292s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c1574e04-564e-4fc7-a93d-2a1ac8829759 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-eaa37f26-4f79-46cb-8f89-fae1851d1f6d" released by "_delete_snapshot" :: held 2.102s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c1574e04-564e-4fc7-a93d-2a1ac8829759 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-e1a0017c-1a49-4a88-a074-671a526fa1d2" released by "delete_snapshot" :: held 2.145s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:50 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-c1574e04-564e-4fc7-a93d-2a1ac8829759 tempest-VolumesSnapshotTestJSON-819713234 None] Created reservations ['8937c05f-9458-4b79-85a0-07544a2ece1d', 'b668d3d4-16b8-4250-aa12-606161bd0f54', '26c72046-b301-4ec5-bafa-dd20d4948e71', '6c7e45bc-7e3f-4393-8c76-510d34e0a4bc'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:19:50 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-c1574e04-564e-4fc7-a93d-2a1ac8829759 tempest-VolumesSnapshotTestJSON-819713234 None] Delete snapshot completed successfully. Sep 09 18:19:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c1574e04-564e-4fc7-a93d-2a1ac8829759 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-eaa37f26-4f79-46cb-8f89-fae1851d1f6d-delete_snapshot" released by "delete_snapshot" :: held 2.360s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Flow 'volume_create_manager' (86bfeda3-1b8f-40e9-911d-682509003025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de994e2-737f-4f7d-a679-a80b289dc8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de994e2-737f-4f7d-a679-a80b289dc8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1884566111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005701b7-9ba4-464c-87ad-80fc7d8a3243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='597b4ec5e39f4c8393ab6ff020a7724f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:19:51Z,use_quota=True,user_id='9742662bfb424806821a554f6493f401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (646c6062-edcc-43cd-adc6-61a78841b62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (646c6062-edcc-43cd-adc6-61a78841b62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413e073e-bfe1-4e99-8ee2-0ed94536a2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (413e073e-bfe1-4e99-8ee2-0ed94536a2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '005701b7-9ba4-464c-87ad-80fc7d8a3243', 'volume_name': 'volume-005701b7-9ba4-464c-87ad-80fc7d8a3243', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ea0114-2d89-4639-9a08-e411943f7736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ea0114-2d89-4639-9a08-e411943f7736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371361b3-8af6-4cd2-b611-716a9a0596f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:51 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Volume 005701b7-9ba4-464c-87ad-80fc7d8a3243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-005701b7-9ba4-464c-87ad-80fc7d8a3243', 'volume_size': 1} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1884566111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005701b7-9ba4-464c-87ad-80fc7d8a3243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='597b4ec5e39f4c8393ab6ff020a7724f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:19:51Z,use_quota=True,user_id='9742662bfb424806821a554f6493f401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Creating volume 005701b7-9ba4-464c-87ad-80fc7d8a3243 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:19:51 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:51 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243 1073741824 Sep 09 18:19:51 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-720fb651-e86e-4252-8251-7d8b92e1527b tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-e1a0017c-1a49-4a88-a074-671a526fa1d2-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-720fb651-e86e-4252-8251-7d8b92e1527b tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-e1a0017c-1a49-4a88-a074-671a526fa1d2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-6a8a707d-a32a-4de2-8327-cc1d1c76396f req-611994f0-63fc-437d-b8a5-eece0f510737 tempest-AttachVolumeTestJSON-1359511233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-720fb651-e86e-4252-8251-7d8b92e1527b tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-quobyte-e1a0017c-1a49-4a88-a074-671a526fa1d2" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:19:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-720fb651-e86e-4252-8251-7d8b92e1527b tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-e1a0017c-1a49-4a88-a074-671a526fa1d2" acquired by "delete_volume" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e093c3a-10df-4757-9c4d-d8bd2f86fc8b]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-720fb651-e86e-4252-8251-7d8b92e1527b tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:52 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243 1073741824" returned: 0 in 0.583s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:52 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 Sep 09 18:19:52 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:52 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243 Sep 09 18:19:52 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:52 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-720fb651-e86e-4252-8251-7d8b92e1527b tempest-VolumesSnapshotTestJSON-819713234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2" returned: 0 in 0.420s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-720fb651-e86e-4252-8251-7d8b92e1527b tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:52 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243" returned: 0 in 0.281s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-6a8a707d-a32a-4de2-8327-cc1d1c76396f req-611994f0-63fc-437d-b8a5-eece0f510737 tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.521s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:52 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2 Sep 09 18:19:52 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371361b3-8af6-4cd2-b611-716a9a0596f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-005701b7-9ba4-464c-87ad-80fc7d8a3243', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5159e16-ddbf-44de-ac09-5f058e96e7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-6a8a707d-a32a-4de2-8327-cc1d1c76396f req-611994f0-63fc-437d-b8a5-eece0f510737 tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:52 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Volume volume-005701b7-9ba4-464c-87ad-80fc7d8a3243 (005701b7-9ba4-464c-87ad-80fc7d8a3243): created successfully Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5159e16-ddbf-44de-ac09-5f058e96e7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Flow 'volume_create_manager' (86bfeda3-1b8f-40e9-911d-682509003025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:19:52 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-4986e34b-81de-4332-a17d-0549c8c00bab tempest-VolumesDeleteCascade-751898372 None] Created volume successfully. Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-6a8a707d-a32a-4de2-8327-cc1d1c76396f req-611994f0-63fc-437d-b8a5-eece0f510737 tempest-AttachVolumeTestJSON-1359511233 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-5a84a727-84f2-4f19-b13b-ef379b68c91c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a45e6051-8ba5-45ae-b6f2-867ee9659767', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:19:52 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-6a8a707d-a32a-4de2-8327-cc1d1c76396f req-611994f0-63fc-437d-b8a5-eece0f510737 tempest-AttachVolumeTestJSON-1359511233 None] attachment_update completed successfully. Sep 09 18:19:52 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-720fb651-e86e-4252-8251-7d8b92e1527b tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e1a0017c-1a49-4a88-a074-671a526fa1d2" returned: 0 in 0.263s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-720fb651-e86e-4252-8251-7d8b92e1527b tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-e1a0017c-1a49-4a88-a074-671a526fa1d2" released by "delete_volume" :: held 0.754s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-720fb651-e86e-4252-8251-7d8b92e1527b tempest-VolumesSnapshotTestJSON-819713234 None] Created reservations ['2f39adeb-2e82-4e55-a54f-c55477a21452', '451729f4-f602-4f83-bf8c-e7278bba375f', '91e36300-06ea-45b3-8636-79905b0b29e7', '32c945da-a729-4718-9a3a-c8a5f5c7d17c'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-720fb651-e86e-4252-8251-7d8b92e1527b tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-720fb651-e86e-4252-8251-7d8b92e1527b tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-720fb651-e86e-4252-8251-7d8b92e1527b tempest-VolumesSnapshotTestJSON-819713234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-720fb651-e86e-4252-8251-7d8b92e1527b tempest-VolumesSnapshotTestJSON-819713234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-720fb651-e86e-4252-8251-7d8b92e1527b tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-720fb651-e86e-4252-8251-7d8b92e1527b tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:52 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:19:52 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:53 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-720fb651-e86e-4252-8251-7d8b92e1527b tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.461s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:53 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-720fb651-e86e-4252-8251-7d8b92e1527b tempest-VolumesSnapshotTestJSON-819713234 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:19:53 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-720fb651-e86e-4252-8251-7d8b92e1527b tempest-VolumesSnapshotTestJSON-819713234 None] Deleted volume successfully. Sep 09 18:19:53 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-720fb651-e86e-4252-8251-7d8b92e1527b tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-e1a0017c-1a49-4a88-a074-671a526fa1d2-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:19:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-799961f3-195a-4137-8940-d48cc762ec3c tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-799961f3-195a-4137-8940-d48cc762ec3c tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-799961f3-195a-4137-8940-d48cc762ec3c tempest-VolumesDeleteCascade-751898372 None] Creating offline snapshot 239d2a67-e503-4101-aa21-d640ec2733a0 of volume 005701b7-9ba4-464c-87ad-80fc7d8a3243 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:19:54 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:19:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Flow 'volume_create_manager' (f77de451-6530-4ee8-bdd1-4ee6c0e3f887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:19:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9a1adc-8b4e-4245-be0a-c574f4e4c02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:54 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[912b53cf-9168-4fab-86f9-dce73a7e4d42]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-799961f3-195a-4137-8940-d48cc762ec3c tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d9a1adc-8b4e-4245-be0a-c574f4e4c02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1110704025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307a2d59-e433-4a9a-9dbd-22bb08168eae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba163d2dee204ebab16ecdbfff9c8913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:19:54Z,use_quota=True,user_id='97af5168b8974f4882c2f0981680df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ed7b00-2ce0-4c2b-b8f0-43a02020bff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ed7b00-2ce0-4c2b-b8f0-43a02020bff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9b69ac-88c8-4433-8ebe-928bf9d2356a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d9b69ac-88c8-4433-8ebe-928bf9d2356a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '307a2d59-e433-4a9a-9dbd-22bb08168eae', 'volume_name': 'volume-307a2d59-e433-4a9a-9dbd-22bb08168eae', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a919d346-2e05-491f-bc15-e02fcf721c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a919d346-2e05-491f-bc15-e02fcf721c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1888ed5-21d7-476d-b2db-433786f47203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:54 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Volume 307a2d59-e433-4a9a-9dbd-22bb08168eae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-307a2d59-e433-4a9a-9dbd-22bb08168eae', 'volume_size': 1} Sep 09 18:19:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:54 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243 Sep 09 18:19:54 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:54 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-799961f3-195a-4137-8940-d48cc762ec3c tempest-VolumesDeleteCascade-751898372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243" returned: 0 in 0.392s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-799961f3-195a-4137-8940-d48cc762ec3c tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:54 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0 1G Sep 09 18:19:54 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:55 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-799961f3-195a-4137-8940-d48cc762ec3c tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0 1G" returned: 0 in 0.451s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-799961f3-195a-4137-8940-d48cc762ec3c tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-005701b7-9ba4-464c-87ad-80fc7d8a3243 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:55 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-005701b7-9ba4-464c-87ad-80fc7d8a3243 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0 Sep 09 18:19:55 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:55 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-799961f3-195a-4137-8940-d48cc762ec3c tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-005701b7-9ba4-464c-87ad-80fc7d8a3243 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0" returned: 0 in 0.337s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:55 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-799961f3-195a-4137-8940-d48cc762ec3c tempest-VolumesDeleteCascade-751898372 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0 is being set with open permissions: ugo+rw Sep 09 18:19:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-799961f3-195a-4137-8940-d48cc762ec3c tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:55 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0 Sep 09 18:19:55 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:55 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-799961f3-195a-4137-8940-d48cc762ec3c tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0" returned: 0 in 0.286s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-799961f3-195a-4137-8940-d48cc762ec3c tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:55 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.info Sep 09 18:19:55 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:55 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:19:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Flow 'volume_create_manager' (189ab391-9ad1-4e52-a114-b73f79ba37fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:19:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44203c2-c12c-40e7-ac56-a3d52d4cefe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d44203c2-c12c-40e7-ac56-a3d52d4cefe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-368297497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491fe4ac-3d5b-4e6c-957a-911c994b621e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659e26cec29d4ab99adec9eb58d93f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:19:56Z,use_quota=True,user_id='94c641d7c5e14e23b1cee39769e64447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff48ce9-fc61-41ad-a32d-2c5a1cfb0417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff48ce9-fc61-41ad-a32d-2c5a1cfb0417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa5cd39-73f1-44c2-9d9c-f28bfe5044ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa5cd39-73f1-44c2-9d9c-f28bfe5044ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '491fe4ac-3d5b-4e6c-957a-911c994b621e', 'volume_name': 'volume-491fe4ac-3d5b-4e6c-957a-911c994b621e', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39663d3-fcfa-4a5f-af60-2899a4a055e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39663d3-fcfa-4a5f-af60-2899a4a055e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1245552-3d2a-40fa-9095-7af9efa0755e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:55 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Volume 491fe4ac-3d5b-4e6c-957a-911c994b621e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-491fe4ac-3d5b-4e6c-957a-911c994b621e', 'volume_size': 1} Sep 09 18:19:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:55 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-799961f3-195a-4137-8940-d48cc762ec3c tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.info" returned: 0 in 0.284s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:55 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-799961f3-195a-4137-8940-d48cc762ec3c tempest-VolumesDeleteCascade-751898372 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.info is being set with open permissions: ugo+rw Sep 09 18:19:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-799961f3-195a-4137-8940-d48cc762ec3c tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:56 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.info Sep 09 18:19:56 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:56 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-799961f3-195a-4137-8940-d48cc762ec3c tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.info" returned: 0 in 0.301s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-799961f3-195a-4137-8940-d48cc762ec3c tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.209s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.063s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1110704025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=307a2d59-e433-4a9a-9dbd-22bb08168eae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba163d2dee204ebab16ecdbfff9c8913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:19:54Z,use_quota=True,user_id='97af5168b8974f4882c2f0981680df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:19:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Creating volume 307a2d59-e433-4a9a-9dbd-22bb08168eae {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:19:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:19:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:19:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:19:56 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:19:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:56 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae 1073741824 Sep 09 18:19:56 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:56 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-799961f3-195a-4137-8940-d48cc762ec3c tempest-VolumesDeleteCascade-751898372 None] Create snapshot completed successfully Sep 09 18:19:56 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae 1073741824" returned: 0 in 0.489s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:56 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae Sep 09 18:19:56 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:57 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae" returned: 0 in 0.298s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.308s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-368297497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491fe4ac-3d5b-4e6c-957a-911c994b621e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='659e26cec29d4ab99adec9eb58d93f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:19:56Z,use_quota=True,user_id='94c641d7c5e14e23b1cee39769e64447',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Creating volume 491fe4ac-3d5b-4e6c-957a-911c994b621e {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:19:57 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-491fe4ac-3d5b-4e6c-957a-911c994b621e 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1888ed5-21d7-476d-b2db-433786f47203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-307a2d59-e433-4a9a-9dbd-22bb08168eae', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:57 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-491fe4ac-3d5b-4e6c-957a-911c994b621e 1073741824 Sep 09 18:19:57 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37f2f80-2e82-4e2b-84ac-7472e736ebc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:57 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Volume volume-307a2d59-e433-4a9a-9dbd-22bb08168eae (307a2d59-e433-4a9a-9dbd-22bb08168eae): created successfully Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37f2f80-2e82-4e2b-84ac-7472e736ebc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Flow 'volume_create_manager' (f77de451-6530-4ee8-bdd1-4ee6c0e3f887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:19:57 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-c1db602d-271f-4edd-ab95-f90561f0b300 tempest-VolumesSnapshotTestJSON-819713234 None] Created volume successfully. Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8f921c8c-dc18-491f-a2a5-0ee54a3e27b1 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:57 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-491fe4ac-3d5b-4e6c-957a-911c994b621e 1073741824" returned: 0 in 0.499s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-491fe4ac-3d5b-4e6c-957a-911c994b621e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:57 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-491fe4ac-3d5b-4e6c-957a-911c994b621e Sep 09 18:19:57 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:57 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-491fe4ac-3d5b-4e6c-957a-911c994b621e" returned: 0 in 0.253s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8f921c8c-dc18-491f-a2a5-0ee54a3e27b1 tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.577s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:19:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-8f921c8c-dc18-491f-a2a5-0ee54a3e27b1 tempest-VolumesDeleteCascade-751898372 None] Creating offline snapshot 0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e of volume 005701b7-9ba4-464c-87ad-80fc7d8a3243 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:19:58 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1245552-3d2a-40fa-9095-7af9efa0755e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-491fe4ac-3d5b-4e6c-957a-911c994b621e', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:58 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70e04866-c5f9-4477-b76e-59cb2cc47611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:19:58 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa473803-ceae-4e24-b827-2db2623ee5f5]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:19:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8f921c8c-dc18-491f-a2a5-0ee54a3e27b1 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:58 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Volume volume-491fe4ac-3d5b-4e6c-957a-911c994b621e (491fe4ac-3d5b-4e6c-957a-911c994b621e): created successfully Sep 09 18:19:58 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70e04866-c5f9-4477-b76e-59cb2cc47611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:19:58 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Flow 'volume_create_manager' (189ab391-9ad1-4e52-a114-b73f79ba37fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:19:58 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-73873b87-ffdb-4a92-953b-be7e08b2bfdb tempest-AttachVolumeTestJSON-1359511233 None] Created volume successfully. Sep 09 18:19:58 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0 Sep 09 18:19:58 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:58 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8f921c8c-dc18-491f-a2a5-0ee54a3e27b1 tempest-VolumesDeleteCascade-751898372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0" returned: 0 in 0.474s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:58 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-8f921c8c-dc18-491f-a2a5-0ee54a3e27b1 tempest-VolumesDeleteCascade-751898372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-005701b7-9ba4-464c-87ad-80fc7d8a3243(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:19:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8f921c8c-dc18-491f-a2a5-0ee54a3e27b1 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:58 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e 1G Sep 09 18:19:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-91ec9570-4947-4b3d-b13e-fdbb4bce48a1 tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:19:58 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:59 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8f921c8c-dc18-491f-a2a5-0ee54a3e27b1 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e 1G" returned: 0 in 0.544s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8f921c8c-dc18-491f-a2a5-0ee54a3e27b1 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:59 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e Sep 09 18:19:59 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:59 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8f921c8c-dc18-491f-a2a5-0ee54a3e27b1 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e" returned: 0 in 0.464s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:59 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-8f921c8c-dc18-491f-a2a5-0ee54a3e27b1 tempest-VolumesDeleteCascade-751898372 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e is being set with open permissions: ugo+rw Sep 09 18:19:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8f921c8c-dc18-491f-a2a5-0ee54a3e27b1 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:19:59 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e Sep 09 18:19:59 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:19:59 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Sep 09 18:19:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8f921c8c-dc18-491f-a2a5-0ee54a3e27b1 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e" returned: 0 in 0.368s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:19:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8f921c8c-dc18-491f-a2a5-0ee54a3e27b1 tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.980s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:19:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-91ec9570-4947-4b3d-b13e-fdbb4bce48a1 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.396s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:00 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-91ec9570-4947-4b3d-b13e-fdbb4bce48a1 tempest-VolumesSnapshotTestJSON-819713234 None] Creating offline snapshot e87d0777-19a3-4cf4-888d-b08ef0044aa2 of volume 307a2d59-e433-4a9a-9dbd-22bb08168eae {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:20:00 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8c356a-7fe1-402d-a75b-20556890ffec]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91ec9570-4947-4b3d-b13e-fdbb4bce48a1 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-98370f93-2eed-4a6b-b4af-2846a8f95295 req-9e427a25-63be-44f9-8bca-52fed4da2dc1 tempest-AttachVolumeTestJSON-1359511233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:00 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-8f921c8c-dc18-491f-a2a5-0ee54a3e27b1 tempest-VolumesDeleteCascade-751898372 None] Create snapshot completed successfully Sep 09 18:20:00 devstack sudo[98236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae Sep 09 18:20:00 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:00 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91ec9570-4947-4b3d-b13e-fdbb4bce48a1 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae" returned: 0 in 0.389s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91ec9570-4947-4b3d-b13e-fdbb4bce48a1 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:00 devstack sudo[98241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2 1G Sep 09 18:20:00 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:00 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91ec9570-4947-4b3d-b13e-fdbb4bce48a1 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2 1G" returned: 0 in 0.404s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91ec9570-4947-4b3d-b13e-fdbb4bce48a1 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-307a2d59-e433-4a9a-9dbd-22bb08168eae -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:00 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-307a2d59-e433-4a9a-9dbd-22bb08168eae -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2 Sep 09 18:20:00 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Flow 'volume_create_manager' (9b50177c-f8ba-4f29-b0b3-1a7ded0b6ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f06d26-b4cb-4d40-bad6-c88a9ce6b480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38f06d26-b4cb-4d40-bad6-c88a9ce6b480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-606598855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5440ff22-25fc-46df-b2f4-6ce5e052fc95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='567a42493f5b4f2ebd178cc59ee769ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:20:01Z,use_quota=True,user_id='1ee69cd49c4d41f1905b609ca6a354a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e67173-8916-471a-ad50-d6a62ae9fbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e67173-8916-471a-ad50-d6a62ae9fbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd1860d4-69a8-494d-8dff-5c33d0f65910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd1860d4-69a8-494d-8dff-5c33d0f65910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5440ff22-25fc-46df-b2f4-6ce5e052fc95', 'volume_name': 'volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c8640e-cd8e-4e1b-b09b-e7e4e6c97cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c8640e-cd8e-4e1b-b09b-e7e4e6c97cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:01 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaeee5cc-0575-4dfe-afed-254da38ae67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:01 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Volume 5440ff22-25fc-46df-b2f4-6ce5e052fc95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95', 'volume_size': 1} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "cinder-005701b7-9ba4-464c-87ad-80fc7d8a3243-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91ec9570-4947-4b3d-b13e-fdbb4bce48a1 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-307a2d59-e433-4a9a-9dbd-22bb08168eae -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2" returned: 0 in 0.347s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:01 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-91ec9570-4947-4b3d-b13e-fdbb4bce48a1 tempest-VolumesSnapshotTestJSON-819713234 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2 is being set with open permissions: ugo+rw Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91ec9570-4947-4b3d-b13e-fdbb4bce48a1 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-005701b7-9ba4-464c-87ad-80fc7d8a3243-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:01 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2 Sep 09 18:20:01 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Performing cascade delete. {{(pid=87639) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "cinder-0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "cinder-quobyte-005701b7-9ba4-464c-87ad-80fc7d8a3243" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-quobyte-005701b7-9ba4-464c-87ad-80fc7d8a3243" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "cinder-quobyte-0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-quobyte-0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Deleting offline snapshot 0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e of volume 005701b7-9ba4-464c-87ad-80fc7d8a3243 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] snapshot_file for this snap is: volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfedeec4-a85e-43bc-99f3-e896b05a7490]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:01 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91ec9570-4947-4b3d-b13e-fdbb4bce48a1 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2" returned: 0 in 0.293s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:01 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e Sep 09 18:20:01 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91ec9570-4947-4b3d-b13e-fdbb4bce48a1 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:01 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.info Sep 09 18:20:01 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:01 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e" returned: 0 in 0.375s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-005701b7-9ba4-464c-87ad-80fc7d8a3243(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d77839-7cd0-4959-92c9-9975a18a0446]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:01 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91ec9570-4947-4b3d-b13e-fdbb4bce48a1 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.info" returned: 0 in 0.274s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:01 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-91ec9570-4947-4b3d-b13e-fdbb4bce48a1 tempest-VolumesSnapshotTestJSON-819713234 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.info is being set with open permissions: ugo+rw Sep 09 18:20:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91ec9570-4947-4b3d-b13e-fdbb4bce48a1 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:01 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.info Sep 09 18:20:01 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:01 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0 Sep 09 18:20:01 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:02 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91ec9570-4947-4b3d-b13e-fdbb4bce48a1 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.info" returned: 0 in 0.258s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-91ec9570-4947-4b3d-b13e-fdbb4bce48a1 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.135s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-98370f93-2eed-4a6b-b4af-2846a8f95295 req-9e427a25-63be-44f9-8bca-52fed4da2dc1 tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.025s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-98370f93-2eed-4a6b-b4af-2846a8f95295 req-9e427a25-63be-44f9-8bca-52fed4da2dc1 tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.949s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-606598855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5440ff22-25fc-46df-b2f4-6ce5e052fc95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='567a42493f5b4f2ebd178cc59ee769ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:20:01Z,use_quota=True,user_id='1ee69cd49c4d41f1905b609ca6a354a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Creating volume 5440ff22-25fc-46df-b2f4-6ce5e052fc95 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:20:02 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:02 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-91ec9570-4947-4b3d-b13e-fdbb4bce48a1 tempest-VolumesSnapshotTestJSON-819713234 None] Create snapshot completed successfully Sep 09 18:20:02 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 1073741824 Sep 09 18:20:02 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:02 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0" returned: 0 in 0.408s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-005701b7-9ba4-464c-87ad-80fc7d8a3243(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-98370f93-2eed-4a6b-b4af-2846a8f95295 req-9e427a25-63be-44f9-8bca-52fed4da2dc1 tempest-AttachVolumeTestJSON-1359511233 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-491fe4ac-3d5b-4e6c-957a-911c994b621e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba5e11d8-720d-4cd9-99e2-a7ed2f1c5deb', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:20:02 devstack sudo[98312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e Sep 09 18:20:02 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:02 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-98370f93-2eed-4a6b-b4af-2846a8f95295 req-9e427a25-63be-44f9-8bca-52fed4da2dc1 tempest-AttachVolumeTestJSON-1359511233 None] attachment_update completed successfully. Sep 09 18:20:02 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e" returned: 0 in 0.444s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:02 devstack sudo[98324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e Sep 09 18:20:02 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:02 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 1073741824" returned: 0 in 0.556s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:02 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 Sep 09 18:20:02 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:02 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e" returned: 0 in 0.260s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-quobyte-0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e" released by "_delete_snapshot" :: held 1.607s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-quobyte-005701b7-9ba4-464c-87ad-80fc7d8a3243" released by "delete_snapshot" :: held 1.638s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:02 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95" returned: 0 in 0.271s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaeee5cc-0575-4dfe-afed-254da38ae67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c213b16-da62-411f-868c-5d50ba5b2401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Created reservations ['34fc368d-898e-4be6-b389-6e4cbcc2415e', 'e33cb33f-3d06-46d6-8ae1-3dffab7c4c32', '24220781-5d9d-490b-b537-71ee82b37ffa', '775a2965-cc6f-4936-a264-0a18dc0bc804'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:20:03 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Volume volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 (5440ff22-25fc-46df-b2f4-6ce5e052fc95): created successfully Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c213b16-da62-411f-868c-5d50ba5b2401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Flow 'volume_create_manager' (9b50177c-f8ba-4f29-b0b3-1a7ded0b6ff1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:20:03 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-2ac958ec-3a80-420e-ac69-78ba58e102ef tempest-VolumesActionsTest-55346329 None] Created volume successfully. Sep 09 18:20:03 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Delete snapshot completed successfully. Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-0bb55a1b-cb35-4f3f-a6dd-e5594f5b4c7e-delete_snapshot" released by "delete_snapshot" :: held 1.867s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "cinder-239d2a67-e503-4101-aa21-d640ec2733a0-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-239d2a67-e503-4101-aa21-d640ec2733a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "cinder-quobyte-005701b7-9ba4-464c-87ad-80fc7d8a3243" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-quobyte-005701b7-9ba4-464c-87ad-80fc7d8a3243" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "cinder-quobyte-239d2a67-e503-4101-aa21-d640ec2733a0" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-quobyte-239d2a67-e503-4101-aa21-d640ec2733a0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Deleting offline snapshot 239d2a67-e503-4101-aa21-d640ec2733a0 of volume 005701b7-9ba4-464c-87ad-80fc7d8a3243 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] snapshot_file for this snap is: volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cf7e31-3dbe-4c6e-8d15-fc258ce75af8]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:03 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0 Sep 09 18:20:03 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Flow 'volume_create_manager' (4bbff2c5-d939-4da4-b26b-7926e893c06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:20:03 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d44eb1-c4af-40ab-b59a-923ddddec485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0" returned: 0 in 0.509s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-005701b7-9ba4-464c-87ad-80fc7d8a3243(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27d44eb1-c4af-40ab-b59a-923ddddec485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1176275393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67495c6c-78de-46fc-89cc-0d544a9977d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba163d2dee204ebab16ecdbfff9c8913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e87d0777-19a3-4cf4-888d-b08ef0044aa2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:20:04Z,use_quota=True,user_id='97af5168b8974f4882c2f0981680df52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b578527d-9786-43b6-bcf4-d15c5a98a646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b578527d-9786-43b6-bcf4-d15c5a98a646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff5c392-6fc4-4dda-b41d-11f476f0e8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ff5c392-6fc4-4dda-b41d-11f476f0e8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '67495c6c-78de-46fc-89cc-0d544a9977d7', 'volume_name': 'volume-67495c6c-78de-46fc-89cc-0d544a9977d7', 'volume_size': 1, 'snapshot_id': 'e87d0777-19a3-4cf4-888d-b08ef0044aa2'}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7949863-9bc1-46ac-8b37-2951a3312578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7949863-9bc1-46ac-8b37-2951a3312578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338b8cc8-2805-45ee-a31d-781ca76a95db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:03 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Volume 67495c6c-78de-46fc-89cc-0d544a9977d7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-67495c6c-78de-46fc-89cc-0d544a9977d7', 'volume_size': 1, 'snapshot_id': 'e87d0777-19a3-4cf4-888d-b08ef0044aa2'} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c13455e-c1c1-4cb7-b5f8-f6233086ebbe]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-quobyte-e87d0777-19a3-4cf4-888d-b08ef0044aa2-67495c6c-78de-46fc-89cc-0d544a9977d7" by "_create_volume_from_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-e87d0777-19a3-4cf4-888d-b08ef0044aa2-67495c6c-78de-46fc-89cc-0d544a9977d7" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Creating volume 67495c6c-78de-46fc-89cc-0d544a9977d7 from snapshot e87d0777-19a3-4cf4-888d-b08ef0044aa2 {{(pid=87639) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-quobyte-67495c6c-78de-46fc-89cc-0d544a9977d7" by "_copy_volume_from_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-67495c6c-78de-46fc-89cc-0d544a9977d7" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] snapshot: e87d0777-19a3-4cf4-888d-b08ef0044aa2, volume: 67495c6c-78de-46fc-89cc-0d544a9977d7, {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 18:20:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:04 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:20:04 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:20:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:04 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b1df42-ca11-4ab5-b38b-1bad8624981e]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:04 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243 Sep 09 18:20:04 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:04 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2 Sep 09 18:20:04 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:04 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243" returned: 0 in 0.496s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:04 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0 Sep 09 18:20:04 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:04 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-8e6dd31c-c64c-4fe7-93a6-7869fd9ee540 req-2b126ddf-0bfb-486e-ac31-3a1efa5315ef tempest-AttachVolumeTestJSON-1359511233 None] Terminate volume connection completed successfully. Sep 09 18:20:04 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-8e6dd31c-c64c-4fe7-93a6-7869fd9ee540 req-2b126ddf-0bfb-486e-ac31-3a1efa5315ef tempest-AttachVolumeTestJSON-1359511233 None] Deleting attachment a45e6051-8ba5-45ae-b6f2-867ee9659767. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:20:04 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2" returned: 0 in 0.585s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:04 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-307a2d59-e433-4a9a-9dbd-22bb08168eae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:20:04 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f7c65f-1354-40d6-9bf0-0306d0d155eb]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:04 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae Sep 09 18:20:04 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:04 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0" returned: 0 in 0.478s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:04 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0 Sep 09 18:20:04 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:05 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae" returned: 0 in 0.453s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:05 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 18:20:05 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Creating direct copy from snapshot {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 18:20:05 devstack cinder-volume[87639]: DEBUG cinder.utils [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Path /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-67495c6c-78de-46fc-89cc-0d544a9977d7 not found in is_blk_device check {{(pid=87639) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 18:20:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-67495c6c-78de-46fc-89cc-0d544a9977d7 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:05 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-67495c6c-78de-46fc-89cc-0d544a9977d7 Sep 09 18:20:05 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:05 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243.239d2a67-e503-4101-aa21-d640ec2733a0" returned: 0 in 0.335s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-quobyte-239d2a67-e503-4101-aa21-d640ec2733a0" released by "_delete_snapshot" :: held 2.013s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-quobyte-005701b7-9ba4-464c-87ad-80fc7d8a3243" released by "delete_snapshot" :: held 2.040s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:05 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Created reservations ['e1a3787b-f9bf-4692-ac80-7ed6278100f2', '665ed9f5-fb88-45c1-9859-8ffcc94b593a', 'e788c179-190c-4ff9-a31b-35769b2aa084', 'eb3a11ab-fd86-46c2-bcf2-dc0733a8d8b0'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:20:05 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Delete snapshot completed successfully. Sep 09 18:20:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-239d2a67-e503-4101-aa21-d640ec2733a0-delete_snapshot" released by "delete_snapshot" :: held 2.237s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:05 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Snapshots deleted, issuing volume delete {{(pid=87639) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 09 18:20:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "cinder-quobyte-005701b7-9ba4-464c-87ad-80fc7d8a3243" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-quobyte-005701b7-9ba4-464c-87ad-80fc7d8a3243" acquired by "delete_volume" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:05 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[28368e50-793c-456a-a126-3fb3d15c4b53]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:05 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243 Sep 09 18:20:05 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:06 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243" returned: 0 in 0.720s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:06 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243 Sep 09 18:20:06 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:06 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=134,cinder:INSERT=37,cinder:UPDATE=126,cinder:DELETE=9 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:20:06 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-6766bfeb-3b34-4315-8715-9984108444ba req-7e22dcfd-93c8-4d8b-93eb-6a6dee18c997 tempest-AttachVolumeTestJSON-1359511233 None] Terminate volume connection completed successfully. Sep 09 18:20:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-6766bfeb-3b34-4315-8715-9984108444ba req-7e22dcfd-93c8-4d8b-93eb-6a6dee18c997 tempest-AttachVolumeTestJSON-1359511233 None] Deleting attachment ba5e11d8-720d-4cd9-99e2-a7ed2f1c5deb. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:20:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-005701b7-9ba4-464c-87ad-80fc7d8a3243" returned: 0 in 0.814s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:06 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:07 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-quobyte-005701b7-9ba4-464c-87ad-80fc7d8a3243" released by "delete_volume" :: held 1.664s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:07 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:UPDATE=126,cinder:SELECT=135,cinder:INSERT=37,cinder:DELETE=15 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:20:07 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Created reservations ['97dd0522-a2a0-4c03-ab23-47f5717f4cc0', '052d61e8-590d-4ca0-8b63-3727dd7e6f15', '6fc38fc7-d9de-4ac6-a86b-c9d342fd19fe', 'f7a374ac-5944-437b-bfa5-d443c650dabb'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:20:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:20:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:20:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:07 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:20:07 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:08 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.638s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:08 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:20:08 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Deleted volume successfully. Sep 09 18:20:08 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d5ec2031-5f6a-41c1-ac58-52411fb8d013 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-005701b7-9ba4-464c-87ad-80fc7d8a3243-delete_volume" released by "delete_volume" :: held 6.998s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:10 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:20:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Flow 'volume_create_manager' (1dea56b8-c324-4e31-aff9-de9e0d988c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:20:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad961a05-0f52-4f4f-878f-6ab19ec640eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad961a05-0f52-4f4f-878f-6ab19ec640eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1546436911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51deb400-ea28-4498-848b-43345ef9c6f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='597b4ec5e39f4c8393ab6ff020a7724f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:20:11Z,use_quota=True,user_id='9742662bfb424806821a554f6493f401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176c218d-58a9-4169-9f9e-94ef6b9a1a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176c218d-58a9-4169-9f9e-94ef6b9a1a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3da8bae-0d4e-449a-9fcc-ee13966f4784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3da8bae-0d4e-449a-9fcc-ee13966f4784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51deb400-ea28-4498-848b-43345ef9c6f1', 'volume_name': 'volume-51deb400-ea28-4498-848b-43345ef9c6f1', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6594e5f4-c5d3-4611-917b-ab72672811a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6594e5f4-c5d3-4611-917b-ab72672811a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365c9006-973d-4937-9b7f-215752508622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:11 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Volume 51deb400-ea28-4498-848b-43345ef9c6f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51deb400-ea28-4498-848b-43345ef9c6f1', 'volume_size': 1} Sep 09 18:20:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:12 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-67495c6c-78de-46fc-89cc-0d544a9977d7" returned: 0 in 6.968s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:12 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Image conversion details: src /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae, size 1024.00 MB, duration 6.97 sec, destination /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-67495c6c-78de-46fc-89cc-0d544a9977d7 {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:20:12 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Converted 1024.00 MB image at 146.93 MB/s Sep 09 18:20:12 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-67495c6c-78de-46fc-89cc-0d544a9977d7 is being set with open permissions: ugo+rw Sep 09 18:20:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-67495c6c-78de-46fc-89cc-0d544a9977d7 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:12 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-67495c6c-78de-46fc-89cc-0d544a9977d7 Sep 09 18:20:12 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:12 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-67495c6c-78de-46fc-89cc-0d544a9977d7" returned: 0 in 0.302s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-67495c6c-78de-46fc-89cc-0d544a9977d7" released by "_copy_volume_from_snapshot" :: held 8.434s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-e87d0777-19a3-4cf4-888d-b08ef0044aa2-67495c6c-78de-46fc-89cc-0d544a9977d7" released by "_create_volume_from_snapshot" :: held 8.511s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.534s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.400s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1546436911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51deb400-ea28-4498-848b-43345ef9c6f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='597b4ec5e39f4c8393ab6ff020a7724f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:20:11Z,use_quota=True,user_id='9742662bfb424806821a554f6493f401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:20:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Creating volume 51deb400-ea28-4498-848b-43345ef9c6f1 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:20:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:20:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:20:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:20:12 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:20:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:12 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1 1073741824 Sep 09 18:20:12 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338b8cc8-2805-45ee-a31d-781ca76a95db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67495c6c-78de-46fc-89cc-0d544a9977d7', 'volume_size': 1, 'snapshot_id': 'e87d0777-19a3-4cf4-888d-b08ef0044aa2'}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5900929c-bd69-4909-83b1-5c76c90f7df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:12 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Volume volume-67495c6c-78de-46fc-89cc-0d544a9977d7 (67495c6c-78de-46fc-89cc-0d544a9977d7): created successfully Sep 09 18:20:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5900929c-bd69-4909-83b1-5c76c90f7df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Flow 'volume_create_manager' (4bbff2c5-d939-4da4-b26b-7926e893c06e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:20:12 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-da50511c-b2b7-4452-93f6-bdf8b6d44c7a tempest-VolumesSnapshotTestJSON-819713234 None] Created volume successfully. Sep 09 18:20:13 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1 1073741824" returned: 0 in 0.595s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:13 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1 Sep 09 18:20:13 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:13 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-09da3e13-a414-445b-bf5d-9988054240dd tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-67495c6c-78de-46fc-89cc-0d544a9977d7-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:13 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-09da3e13-a414-445b-bf5d-9988054240dd tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-67495c6c-78de-46fc-89cc-0d544a9977d7-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:13 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1" returned: 0 in 0.468s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:20:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365c9006-973d-4937-9b7f-215752508622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51deb400-ea28-4498-848b-43345ef9c6f1', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df49f74-5521-47c9-946f-5f2262f4d653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:13 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-09da3e13-a414-445b-bf5d-9988054240dd tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-quobyte-67495c6c-78de-46fc-89cc-0d544a9977d7" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:13 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Volume volume-51deb400-ea28-4498-848b-43345ef9c6f1 (51deb400-ea28-4498-848b-43345ef9c6f1): created successfully Sep 09 18:20:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7df49f74-5521-47c9-946f-5f2262f4d653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Flow 'volume_create_manager' (1dea56b8-c324-4e31-aff9-de9e0d988c4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:20:13 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-09da3e13-a414-445b-bf5d-9988054240dd tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-67495c6c-78de-46fc-89cc-0d544a9977d7" acquired by "delete_volume" :: waited 0.079s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:13 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-08f60048-7af1-4e35-81a7-085053a5e1b3 tempest-VolumesDeleteCascade-751898372 None] Created volume successfully. Sep 09 18:20:13 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f6fd4d-d952-4e16-a7a6-fcb6ed45f31f]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-09da3e13-a414-445b-bf5d-9988054240dd tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-67495c6c-78de-46fc-89cc-0d544a9977d7 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:14 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-67495c6c-78de-46fc-89cc-0d544a9977d7 Sep 09 18:20:14 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-350ea31f-be59-4e33-93e8-bc9c7d1969f8 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-350ea31f-be59-4e33-93e8-bc9c7d1969f8 tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:14 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-09da3e13-a414-445b-bf5d-9988054240dd tempest-VolumesSnapshotTestJSON-819713234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-67495c6c-78de-46fc-89cc-0d544a9977d7" returned: 0 in 0.949s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-09da3e13-a414-445b-bf5d-9988054240dd tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-67495c6c-78de-46fc-89cc-0d544a9977d7 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-350ea31f-be59-4e33-93e8-bc9c7d1969f8 tempest-VolumesDeleteCascade-751898372 None] Creating offline snapshot aebcf594-7506-4c75-b032-23cce63c8dc7 of volume 51deb400-ea28-4498-848b-43345ef9c6f1 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:20:14 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00a9a36-3ed5-4b6c-9e8f-b4a1f7a4eb16]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-350ea31f-be59-4e33-93e8-bc9c7d1969f8 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:14 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-67495c6c-78de-46fc-89cc-0d544a9977d7 Sep 09 18:20:14 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:15 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1 Sep 09 18:20:15 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:15 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-09da3e13-a414-445b-bf5d-9988054240dd tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-67495c6c-78de-46fc-89cc-0d544a9977d7" returned: 0 in 0.585s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-09da3e13-a414-445b-bf5d-9988054240dd tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-67495c6c-78de-46fc-89cc-0d544a9977d7" released by "delete_volume" :: held 1.661s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:15 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-09da3e13-a414-445b-bf5d-9988054240dd tempest-VolumesSnapshotTestJSON-819713234 None] Created reservations ['5a61924d-00ce-47bf-a54d-75f0b16aa1ab', '25c0d713-4692-4379-8ab0-cb3d4ce5917f', 'fe96ca07-0fcf-4bc4-bd8b-621a8f9b16f7', 'f988f588-5c5e-47f2-87c5-0dd5f036645e'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:20:15 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-350ea31f-be59-4e33-93e8-bc9c7d1969f8 tempest-VolumesDeleteCascade-751898372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1" returned: 0 in 0.838s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-350ea31f-be59-4e33-93e8-bc9c7d1969f8 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:15 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7 1G Sep 09 18:20:15 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-09da3e13-a414-445b-bf5d-9988054240dd tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-09da3e13-a414-445b-bf5d-9988054240dd tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:15 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-09da3e13-a414-445b-bf5d-9988054240dd tempest-VolumesSnapshotTestJSON-819713234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:20:15 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-09da3e13-a414-445b-bf5d-9988054240dd tempest-VolumesSnapshotTestJSON-819713234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:20:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-09da3e13-a414-445b-bf5d-9988054240dd tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-09da3e13-a414-445b-bf5d-9988054240dd tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:15 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:20:15 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0e5295e9-e2f4-4958-9b0a-164c7e590f1e tempest-AttachVolumeTestJSON-1359511233 None] Acquiring lock "cinder-491fe4ac-3d5b-4e6c-957a-911c994b621e-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0e5295e9-e2f4-4958-9b0a-164c7e590f1e tempest-AttachVolumeTestJSON-1359511233 None] Lock "cinder-491fe4ac-3d5b-4e6c-957a-911c994b621e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0e5295e9-e2f4-4958-9b0a-164c7e590f1e tempest-AttachVolumeTestJSON-1359511233 None] Acquiring lock "cinder-quobyte-491fe4ac-3d5b-4e6c-957a-911c994b621e" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0e5295e9-e2f4-4958-9b0a-164c7e590f1e tempest-AttachVolumeTestJSON-1359511233 None] Lock "cinder-quobyte-491fe4ac-3d5b-4e6c-957a-911c994b621e" acquired by "delete_volume" :: waited 0.074s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-41857f85-245a-4948-b423-207979b3d674 tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-e87d0777-19a3-4cf4-888d-b08ef0044aa2-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb87845d-e5f4-450c-8df6-b00c8bfdd10a]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0e5295e9-e2f4-4958-9b0a-164c7e590f1e tempest-AttachVolumeTestJSON-1359511233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-491fe4ac-3d5b-4e6c-957a-911c994b621e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-41857f85-245a-4948-b423-207979b3d674 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-e87d0777-19a3-4cf4-888d-b08ef0044aa2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-41857f85-245a-4948-b423-207979b3d674 tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-quobyte-307a2d59-e433-4a9a-9dbd-22bb08168eae" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-41857f85-245a-4948-b423-207979b3d674 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-307a2d59-e433-4a9a-9dbd-22bb08168eae" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-41857f85-245a-4948-b423-207979b3d674 tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-quobyte-e87d0777-19a3-4cf4-888d-b08ef0044aa2" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-41857f85-245a-4948-b423-207979b3d674 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-e87d0777-19a3-4cf4-888d-b08ef0044aa2" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-41857f85-245a-4948-b423-207979b3d674 tempest-VolumesSnapshotTestJSON-819713234 None] Deleting offline snapshot e87d0777-19a3-4cf4-888d-b08ef0044aa2 of volume 307a2d59-e433-4a9a-9dbd-22bb08168eae {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-41857f85-245a-4948-b423-207979b3d674 tempest-VolumesSnapshotTestJSON-819713234 None] snapshot_file for this snap is: volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:20:16 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-09da3e13-a414-445b-bf5d-9988054240dd tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.711s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-09da3e13-a414-445b-bf5d-9988054240dd tempest-VolumesSnapshotTestJSON-819713234 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b5618a-42aa-4eb4-8889-43fab578d513]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-41857f85-245a-4948-b423-207979b3d674 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:16 devstack sudo[98569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-491fe4ac-3d5b-4e6c-957a-911c994b621e Sep 09 18:20:16 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:16 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-09da3e13-a414-445b-bf5d-9988054240dd tempest-VolumesSnapshotTestJSON-819713234 None] Deleted volume successfully. Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-09da3e13-a414-445b-bf5d-9988054240dd tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-67495c6c-78de-46fc-89cc-0d544a9977d7-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:16 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2 Sep 09 18:20:16 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:16 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-350ea31f-be59-4e33-93e8-bc9c7d1969f8 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7 1G" returned: 0 in 1.001s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-350ea31f-be59-4e33-93e8-bc9c7d1969f8 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51deb400-ea28-4498-848b-43345ef9c6f1 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:16 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51deb400-ea28-4498-848b-43345ef9c6f1 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7 Sep 09 18:20:16 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:16 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0e5295e9-e2f4-4958-9b0a-164c7e590f1e tempest-AttachVolumeTestJSON-1359511233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-491fe4ac-3d5b-4e6c-957a-911c994b621e" returned: 0 in 0.532s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0e5295e9-e2f4-4958-9b0a-164c7e590f1e tempest-AttachVolumeTestJSON-1359511233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-491fe4ac-3d5b-4e6c-957a-911c994b621e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:16 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-491fe4ac-3d5b-4e6c-957a-911c994b621e Sep 09 18:20:16 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:16 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-41857f85-245a-4948-b423-207979b3d674 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2" returned: 0 in 0.435s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-41857f85-245a-4948-b423-207979b3d674 tempest-VolumesSnapshotTestJSON-819713234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-307a2d59-e433-4a9a-9dbd-22bb08168eae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d96a28-b79f-48fc-a5ef-096b214e6e6e]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-41857f85-245a-4948-b423-207979b3d674 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:16 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-350ea31f-be59-4e33-93e8-bc9c7d1969f8 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51deb400-ea28-4498-848b-43345ef9c6f1 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7" returned: 0 in 0.359s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:16 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-350ea31f-be59-4e33-93e8-bc9c7d1969f8 tempest-VolumesDeleteCascade-751898372 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7 is being set with open permissions: ugo+rw Sep 09 18:20:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-350ea31f-be59-4e33-93e8-bc9c7d1969f8 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:17 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7 Sep 09 18:20:17 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:17 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae Sep 09 18:20:17 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:17 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0e5295e9-e2f4-4958-9b0a-164c7e590f1e tempest-AttachVolumeTestJSON-1359511233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-491fe4ac-3d5b-4e6c-957a-911c994b621e" returned: 0 in 0.347s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:17 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0e5295e9-e2f4-4958-9b0a-164c7e590f1e tempest-AttachVolumeTestJSON-1359511233 None] Lock "cinder-quobyte-491fe4ac-3d5b-4e6c-957a-911c994b621e" released by "delete_volume" :: held 1.011s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:17 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-350ea31f-be59-4e33-93e8-bc9c7d1969f8 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7" returned: 0 in 0.327s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:17 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-0e5295e9-e2f4-4958-9b0a-164c7e590f1e tempest-AttachVolumeTestJSON-1359511233 None] Created reservations ['0b6c8f31-6f30-42c8-b9f5-68431d1a4352', '881cd1f9-6981-43b7-af17-f4243866027d', '9099029f-9b26-45de-807e-5b67545a3fc1', '7a401f98-e1c5-48a7-8010-265a9f0c8520'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:20:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-350ea31f-be59-4e33-93e8-bc9c7d1969f8 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:17 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.info Sep 09 18:20:17 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0e5295e9-e2f4-4958-9b0a-164c7e590f1e tempest-AttachVolumeTestJSON-1359511233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0e5295e9-e2f4-4958-9b0a-164c7e590f1e tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0e5295e9-e2f4-4958-9b0a-164c7e590f1e tempest-AttachVolumeTestJSON-1359511233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:20:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0e5295e9-e2f4-4958-9b0a-164c7e590f1e tempest-AttachVolumeTestJSON-1359511233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:20:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0e5295e9-e2f4-4958-9b0a-164c7e590f1e tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0e5295e9-e2f4-4958-9b0a-164c7e590f1e tempest-AttachVolumeTestJSON-1359511233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:17 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:20:17 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:17 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-41857f85-245a-4948-b423-207979b3d674 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae" returned: 0 in 0.837s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-41857f85-245a-4948-b423-207979b3d674 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:17 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-809e85b2-5c2d-432c-870e-bebff3ac2a49 tempest-VolumesActionsTest-55346329 None] Acquiring lock "cinder-5440ff22-25fc-46df-b2f4-6ce5e052fc95" by "attach_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:17 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2 Sep 09 18:20:17 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:17 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-809e85b2-5c2d-432c-870e-bebff3ac2a49 tempest-VolumesActionsTest-55346329 None] Lock "cinder-5440ff22-25fc-46df-b2f4-6ce5e052fc95" acquired by "attach_volume" :: waited 0.043s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:17 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-350ea31f-be59-4e33-93e8-bc9c7d1969f8 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.info" returned: 0 in 0.543s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:17 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-350ea31f-be59-4e33-93e8-bc9c7d1969f8 tempest-VolumesDeleteCascade-751898372 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.info is being set with open permissions: ugo+rw Sep 09 18:20:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-350ea31f-be59-4e33-93e8-bc9c7d1969f8 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:18 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-809e85b2-5c2d-432c-870e-bebff3ac2a49 tempest-VolumesActionsTest-55346329 None] Attaching volume 5440ff22-25fc-46df-b2f4-6ce5e052fc95 to instance a74ea5b3-3aed-4867-a611-e0b6de1dc4c4 at mountpoint /dev/vdb on host None. Sep 09 18:20:18 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.info Sep 09 18:20:18 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:18 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-809e85b2-5c2d-432c-870e-bebff3ac2a49 tempest-VolumesActionsTest-55346329 None] Attach volume completed successfully. Sep 09 18:20:18 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0e5295e9-e2f4-4958-9b0a-164c7e590f1e tempest-AttachVolumeTestJSON-1359511233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.609s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:18 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-0e5295e9-e2f4-4958-9b0a-164c7e590f1e tempest-AttachVolumeTestJSON-1359511233 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:20:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-809e85b2-5c2d-432c-870e-bebff3ac2a49 tempest-VolumesActionsTest-55346329 None] Lock "cinder-5440ff22-25fc-46df-b2f4-6ce5e052fc95" released by "attach_volume" :: held 0.269s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:18 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-0e5295e9-e2f4-4958-9b0a-164c7e590f1e tempest-AttachVolumeTestJSON-1359511233 None] Deleted volume successfully. Sep 09 18:20:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0e5295e9-e2f4-4958-9b0a-164c7e590f1e tempest-AttachVolumeTestJSON-1359511233 None] Lock "cinder-491fe4ac-3d5b-4e6c-957a-911c994b621e-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:18 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-41857f85-245a-4948-b423-207979b3d674 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2" returned: 0 in 0.555s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-41857f85-245a-4948-b423-207979b3d674 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:18 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2 Sep 09 18:20:18 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:18 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-43462e14-4ea8-4368-b2e0-30057ed2d70e tempest-VolumesActionsTest-55346329 None] Acquiring lock "cinder-5440ff22-25fc-46df-b2f4-6ce5e052fc95-detach_volume" by "detach_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-350ea31f-be59-4e33-93e8-bc9c7d1969f8 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.info" returned: 0 in 0.492s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-350ea31f-be59-4e33-93e8-bc9c7d1969f8 tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.844s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-43462e14-4ea8-4368-b2e0-30057ed2d70e tempest-VolumesActionsTest-55346329 None] Lock "cinder-5440ff22-25fc-46df-b2f4-6ce5e052fc95-detach_volume" acquired by "detach_volume" :: waited 0.110s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:18 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-43462e14-4ea8-4368-b2e0-30057ed2d70e tempest-VolumesActionsTest-55346329 None] Detaching volume 5440ff22-25fc-46df-b2f4-6ce5e052fc95 from instance a74ea5b3-3aed-4867-a611-e0b6de1dc4c4. Sep 09 18:20:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-25bb4965-e225-4518-afeb-43008880807f tempest-AttachVolumeTestJSON-1359511233 None] Acquiring lock "cinder-5a84a727-84f2-4f19-b13b-ef379b68c91c-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:18 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-350ea31f-be59-4e33-93e8-bc9c7d1969f8 tempest-VolumesDeleteCascade-751898372 None] Create snapshot completed successfully Sep 09 18:20:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-25bb4965-e225-4518-afeb-43008880807f tempest-AttachVolumeTestJSON-1359511233 None] Lock "cinder-5a84a727-84f2-4f19-b13b-ef379b68c91c-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-25bb4965-e225-4518-afeb-43008880807f tempest-AttachVolumeTestJSON-1359511233 None] Acquiring lock "cinder-quobyte-5a84a727-84f2-4f19-b13b-ef379b68c91c" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:18 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-43462e14-4ea8-4368-b2e0-30057ed2d70e tempest-VolumesActionsTest-55346329 None] Detach volume completed successfully. Sep 09 18:20:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-25bb4965-e225-4518-afeb-43008880807f tempest-AttachVolumeTestJSON-1359511233 None] Lock "cinder-quobyte-5a84a727-84f2-4f19-b13b-ef379b68c91c" acquired by "delete_volume" :: waited 0.033s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-43462e14-4ea8-4368-b2e0-30057ed2d70e tempest-VolumesActionsTest-55346329 None] Lock "cinder-5440ff22-25fc-46df-b2f4-6ce5e052fc95-detach_volume" released by "detach_volume" :: held 0.234s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:18 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[28dea7ff-5150-4239-9da3-a86c4930c97b]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-25bb4965-e225-4518-afeb-43008880807f tempest-AttachVolumeTestJSON-1359511233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5a84a727-84f2-4f19-b13b-ef379b68c91c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:18 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-41857f85-245a-4948-b423-207979b3d674 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae.e87d0777-19a3-4cf4-888d-b08ef0044aa2" returned: 0 in 0.516s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-41857f85-245a-4948-b423-207979b3d674 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-e87d0777-19a3-4cf4-888d-b08ef0044aa2" released by "_delete_snapshot" :: held 2.527s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-41857f85-245a-4948-b423-207979b3d674 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-307a2d59-e433-4a9a-9dbd-22bb08168eae" released by "delete_snapshot" :: held 2.574s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:19 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5a84a727-84f2-4f19-b13b-ef379b68c91c Sep 09 18:20:19 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:19 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-41857f85-245a-4948-b423-207979b3d674 tempest-VolumesSnapshotTestJSON-819713234 None] Created reservations ['741d95a6-d73e-4f2e-bd6e-d40b27351e10', '2ef214b8-2283-489e-b683-943f7c6cf241', '7b44c1ba-96c6-46c9-b59b-34f84c917273', '2b16c987-e9dd-40d2-b0e3-0cf730d81f24'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:20:19 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-41857f85-245a-4948-b423-207979b3d674 tempest-VolumesSnapshotTestJSON-819713234 None] Delete snapshot completed successfully. Sep 09 18:20:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-41857f85-245a-4948-b423-207979b3d674 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-e87d0777-19a3-4cf4-888d-b08ef0044aa2-delete_snapshot" released by "delete_snapshot" :: held 2.847s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:19 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-25bb4965-e225-4518-afeb-43008880807f tempest-AttachVolumeTestJSON-1359511233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5a84a727-84f2-4f19-b13b-ef379b68c91c" returned: 0 in 0.725s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-25bb4965-e225-4518-afeb-43008880807f tempest-AttachVolumeTestJSON-1359511233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5a84a727-84f2-4f19-b13b-ef379b68c91c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:19 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5a84a727-84f2-4f19-b13b-ef379b68c91c Sep 09 18:20:19 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d2244002-e9d2-47fc-9200-8b0fe6fafcf5 tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-307a2d59-e433-4a9a-9dbd-22bb08168eae-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d2244002-e9d2-47fc-9200-8b0fe6fafcf5 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-307a2d59-e433-4a9a-9dbd-22bb08168eae-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d2244002-e9d2-47fc-9200-8b0fe6fafcf5 tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-quobyte-307a2d59-e433-4a9a-9dbd-22bb08168eae" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d2244002-e9d2-47fc-9200-8b0fe6fafcf5 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-307a2d59-e433-4a9a-9dbd-22bb08168eae" acquired by "delete_volume" :: waited 0.057s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab3d049-20ac-44d8-8348-d6d65ff4350a]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d2244002-e9d2-47fc-9200-8b0fe6fafcf5 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:20 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-25bb4965-e225-4518-afeb-43008880807f tempest-AttachVolumeTestJSON-1359511233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5a84a727-84f2-4f19-b13b-ef379b68c91c" returned: 0 in 0.539s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-25bb4965-e225-4518-afeb-43008880807f tempest-AttachVolumeTestJSON-1359511233 None] Lock "cinder-quobyte-5a84a727-84f2-4f19-b13b-ef379b68c91c" released by "delete_volume" :: held 1.361s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Flow 'volume_create_manager' (349262fd-7326-4f0e-9a36-1606b158f1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed881606-9e00-4e5a-86db-b419d3c1d0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed881606-9e00-4e5a-86db-b419d3c1d0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-617349218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bfae0c9-0d1a-4148-90af-149c3ef72f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='597b4ec5e39f4c8393ab6ff020a7724f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aebcf594-7506-4c75-b032-23cce63c8dc7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:20:20Z,use_quota=True,user_id='9742662bfb424806821a554f6493f401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2900e3c5-9b02-4fa0-8140-3708d62cbe63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2900e3c5-9b02-4fa0-8140-3708d62cbe63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:20 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae Sep 09 18:20:20 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba82d4eb-36f8-4539-96db-dbb365af963f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba82d4eb-36f8-4539-96db-dbb365af963f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5bfae0c9-0d1a-4148-90af-149c3ef72f0e', 'volume_name': 'volume-5bfae0c9-0d1a-4148-90af-149c3ef72f0e', 'volume_size': 1, 'snapshot_id': 'aebcf594-7506-4c75-b032-23cce63c8dc7'}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f814be-e0be-4302-a33f-32c4029f6349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f814be-e0be-4302-a33f-32c4029f6349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce03470a-af7f-4e4a-bb78-7da086e091e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:20 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Volume 5bfae0c9-0d1a-4148-90af-149c3ef72f0e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5bfae0c9-0d1a-4148-90af-149c3ef72f0e', 'volume_size': 1, 'snapshot_id': 'aebcf594-7506-4c75-b032-23cce63c8dc7'} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "cinder-quobyte-aebcf594-7506-4c75-b032-23cce63c8dc7-5bfae0c9-0d1a-4148-90af-149c3ef72f0e" by "_create_volume_from_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-quobyte-aebcf594-7506-4c75-b032-23cce63c8dc7-5bfae0c9-0d1a-4148-90af-149c3ef72f0e" acquired by "_create_volume_from_snapshot" :: waited 0.056s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Creating volume 5bfae0c9-0d1a-4148-90af-149c3ef72f0e from snapshot aebcf594-7506-4c75-b032-23cce63c8dc7 {{(pid=87639) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "cinder-quobyte-5bfae0c9-0d1a-4148-90af-149c3ef72f0e" by "_copy_volume_from_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-25bb4965-e225-4518-afeb-43008880807f tempest-AttachVolumeTestJSON-1359511233 None] Created reservations ['0d8a1ec1-6f49-4ab8-9d44-e0ee78ca045d', 'fa46767e-18d1-4fb4-8e29-7f41d0550518', 'ce9b4528-3fff-482f-9bf1-74c3e9ec0c48', 'dd000eb8-bee2-42a5-9e99-38d6af523b3e'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-quobyte-5bfae0c9-0d1a-4148-90af-149c3ef72f0e" acquired by "_copy_volume_from_snapshot" :: waited 0.072s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] snapshot: aebcf594-7506-4c75-b032-23cce63c8dc7, volume: 5bfae0c9-0d1a-4148-90af-149c3ef72f0e, {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f104e439-84ee-4e9b-abb0-1ed5ef0fe84b]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-25bb4965-e225-4518-afeb-43008880807f tempest-AttachVolumeTestJSON-1359511233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-25bb4965-e225-4518-afeb-43008880807f tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-25bb4965-e225-4518-afeb-43008880807f tempest-AttachVolumeTestJSON-1359511233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-25bb4965-e225-4518-afeb-43008880807f tempest-AttachVolumeTestJSON-1359511233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-25bb4965-e225-4518-afeb-43008880807f tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-25bb4965-e225-4518-afeb-43008880807f tempest-AttachVolumeTestJSON-1359511233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:20 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d2244002-e9d2-47fc-9200-8b0fe6fafcf5 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae" returned: 0 in 0.516s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d2244002-e9d2-47fc-9200-8b0fe6fafcf5 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:20 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:20:20 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:20 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae Sep 09 18:20:20 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:20 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7 Sep 09 18:20:20 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:20 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-25bb4965-e225-4518-afeb-43008880807f tempest-AttachVolumeTestJSON-1359511233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.325s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-25bb4965-e225-4518-afeb-43008880807f tempest-AttachVolumeTestJSON-1359511233 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:20:20 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-25bb4965-e225-4518-afeb-43008880807f tempest-AttachVolumeTestJSON-1359511233 None] Deleted volume successfully. Sep 09 18:20:20 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-25bb4965-e225-4518-afeb-43008880807f tempest-AttachVolumeTestJSON-1359511233 None] Lock "cinder-5a84a727-84f2-4f19-b13b-ef379b68c91c-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:21 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d2244002-e9d2-47fc-9200-8b0fe6fafcf5 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-307a2d59-e433-4a9a-9dbd-22bb08168eae" returned: 0 in 0.495s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d2244002-e9d2-47fc-9200-8b0fe6fafcf5 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-307a2d59-e433-4a9a-9dbd-22bb08168eae" released by "delete_volume" :: held 1.160s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-d2244002-e9d2-47fc-9200-8b0fe6fafcf5 tempest-VolumesSnapshotTestJSON-819713234 None] Created reservations ['8e4f73a3-c1bc-4b09-ab26-ae5afdddb285', '1a847905-a3f1-4f3a-9c08-3a6175496e98', '9b709a81-0e0d-4ff8-98a2-a76bff66558c', '48480588-961b-4299-a81c-d1bc36627e2b'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:20:21 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7" returned: 0 in 0.757s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51deb400-ea28-4498-848b-43345ef9c6f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bd0872-46b2-45fc-b53d-3618131bbdd7]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b43f4868-c32c-4487-8f1d-c582d162327c tempest-AttachVolumeTestJSON-1359511233 None] Acquiring lock "cinder-6183f299-1344-47b7-8a3f-dd8a31d16ab6-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b43f4868-c32c-4487-8f1d-c582d162327c tempest-AttachVolumeTestJSON-1359511233 None] Lock "cinder-6183f299-1344-47b7-8a3f-dd8a31d16ab6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d2244002-e9d2-47fc-9200-8b0fe6fafcf5 tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d2244002-e9d2-47fc-9200-8b0fe6fafcf5 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d2244002-e9d2-47fc-9200-8b0fe6fafcf5 tempest-VolumesSnapshotTestJSON-819713234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d2244002-e9d2-47fc-9200-8b0fe6fafcf5 tempest-VolumesSnapshotTestJSON-819713234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d2244002-e9d2-47fc-9200-8b0fe6fafcf5 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d2244002-e9d2-47fc-9200-8b0fe6fafcf5 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:21 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1 Sep 09 18:20:21 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b43f4868-c32c-4487-8f1d-c582d162327c tempest-AttachVolumeTestJSON-1359511233 None] Acquiring lock "cinder-quobyte-6183f299-1344-47b7-8a3f-dd8a31d16ab6" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:21 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:20:21 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b43f4868-c32c-4487-8f1d-c582d162327c tempest-AttachVolumeTestJSON-1359511233 None] Lock "cinder-quobyte-6183f299-1344-47b7-8a3f-dd8a31d16ab6" acquired by "delete_volume" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d19cd0b-55b0-4ae3-a734-d6f2b6fac656]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b43f4868-c32c-4487-8f1d-c582d162327c tempest-AttachVolumeTestJSON-1359511233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6183f299-1344-47b7-8a3f-dd8a31d16ab6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:21 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6183f299-1344-47b7-8a3f-dd8a31d16ab6 Sep 09 18:20:21 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:21 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1" returned: 0 in 0.448s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1 {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Creating direct copy from snapshot {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG cinder.utils [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Path /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5bfae0c9-0d1a-4148-90af-149c3ef72f0e not found in is_blk_device check {{(pid=87639) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5bfae0c9-0d1a-4148-90af-149c3ef72f0e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:21 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d2244002-e9d2-47fc-9200-8b0fe6fafcf5 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.323s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-d2244002-e9d2-47fc-9200-8b0fe6fafcf5 tempest-VolumesSnapshotTestJSON-819713234 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:20:21 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d2244002-e9d2-47fc-9200-8b0fe6fafcf5 tempest-VolumesSnapshotTestJSON-819713234 None] Deleted volume successfully. Sep 09 18:20:21 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5bfae0c9-0d1a-4148-90af-149c3ef72f0e Sep 09 18:20:21 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d2244002-e9d2-47fc-9200-8b0fe6fafcf5 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-307a2d59-e433-4a9a-9dbd-22bb08168eae-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:21 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b43f4868-c32c-4487-8f1d-c582d162327c tempest-AttachVolumeTestJSON-1359511233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6183f299-1344-47b7-8a3f-dd8a31d16ab6" returned: 0 in 0.372s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b43f4868-c32c-4487-8f1d-c582d162327c tempest-AttachVolumeTestJSON-1359511233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6183f299-1344-47b7-8a3f-dd8a31d16ab6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:21 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6183f299-1344-47b7-8a3f-dd8a31d16ab6 Sep 09 18:20:21 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:22 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b43f4868-c32c-4487-8f1d-c582d162327c tempest-AttachVolumeTestJSON-1359511233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6183f299-1344-47b7-8a3f-dd8a31d16ab6" returned: 0 in 0.280s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:22 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b43f4868-c32c-4487-8f1d-c582d162327c tempest-AttachVolumeTestJSON-1359511233 None] Lock "cinder-quobyte-6183f299-1344-47b7-8a3f-dd8a31d16ab6" released by "delete_volume" :: held 0.703s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:22 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e20ca77b-15f1-4f27-8ef4-49386d48d3b6 tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-b6f69172-9e4b-45e3-867b-16051676ceaf-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:22 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e20ca77b-15f1-4f27-8ef4-49386d48d3b6 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-b6f69172-9e4b-45e3-867b-16051676ceaf-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:22 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-b43f4868-c32c-4487-8f1d-c582d162327c tempest-AttachVolumeTestJSON-1359511233 None] Created reservations ['fece834b-431c-4425-9286-6519810fd443', '42aab3f0-4492-452c-9542-328e01c616a9', '591f86bc-2661-40a6-aac5-99e10d69ea39', '165f4a89-eeb2-45ed-a16e-2ee38614d399'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:20:22 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e20ca77b-15f1-4f27-8ef4-49386d48d3b6 tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "cinder-quobyte-b6f69172-9e4b-45e3-867b-16051676ceaf" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:22 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e20ca77b-15f1-4f27-8ef4-49386d48d3b6 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-b6f69172-9e4b-45e3-867b-16051676ceaf" acquired by "delete_volume" :: waited 0.065s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:22 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[abba329b-83a1-40b4-8101-3cc459d8e3c6]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e20ca77b-15f1-4f27-8ef4-49386d48d3b6 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b43f4868-c32c-4487-8f1d-c582d162327c tempest-AttachVolumeTestJSON-1359511233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b43f4868-c32c-4487-8f1d-c582d162327c tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b43f4868-c32c-4487-8f1d-c582d162327c tempest-AttachVolumeTestJSON-1359511233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:20:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b43f4868-c32c-4487-8f1d-c582d162327c tempest-AttachVolumeTestJSON-1359511233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:20:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b43f4868-c32c-4487-8f1d-c582d162327c tempest-AttachVolumeTestJSON-1359511233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b43f4868-c32c-4487-8f1d-c582d162327c tempest-AttachVolumeTestJSON-1359511233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:22 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf Sep 09 18:20:22 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:23 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:20:23 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:23 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b43f4868-c32c-4487-8f1d-c582d162327c tempest-AttachVolumeTestJSON-1359511233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.469s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:23 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-b43f4868-c32c-4487-8f1d-c582d162327c tempest-AttachVolumeTestJSON-1359511233 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:20:23 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-b43f4868-c32c-4487-8f1d-c582d162327c tempest-AttachVolumeTestJSON-1359511233 None] Deleted volume successfully. Sep 09 18:20:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b43f4868-c32c-4487-8f1d-c582d162327c tempest-AttachVolumeTestJSON-1359511233 None] Lock "cinder-6183f299-1344-47b7-8a3f-dd8a31d16ab6-delete_volume" released by "delete_volume" :: held 2.145s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:23 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e20ca77b-15f1-4f27-8ef4-49386d48d3b6 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf" returned: 0 in 0.883s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e20ca77b-15f1-4f27-8ef4-49386d48d3b6 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:23 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf Sep 09 18:20:23 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:24 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e20ca77b-15f1-4f27-8ef4-49386d48d3b6 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b6f69172-9e4b-45e3-867b-16051676ceaf" returned: 0 in 1.100s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:24 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e20ca77b-15f1-4f27-8ef4-49386d48d3b6 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-quobyte-b6f69172-9e4b-45e3-867b-16051676ceaf" released by "delete_volume" :: held 2.163s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:24 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-e20ca77b-15f1-4f27-8ef4-49386d48d3b6 tempest-VolumesSnapshotTestJSON-819713234 None] Created reservations ['609d0105-12eb-45ef-9ec8-54d2c5a1d04e', 'a76cc2e4-76cf-40bf-a373-d778cac71101', 'eedc90d0-c901-4920-97f3-1f4773a43584', 'af268699-4926-47ff-830e-ea2a69a42f7f'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:20:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e20ca77b-15f1-4f27-8ef4-49386d48d3b6 tempest-VolumesSnapshotTestJSON-819713234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e20ca77b-15f1-4f27-8ef4-49386d48d3b6 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:25 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e20ca77b-15f1-4f27-8ef4-49386d48d3b6 tempest-VolumesSnapshotTestJSON-819713234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:20:25 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e20ca77b-15f1-4f27-8ef4-49386d48d3b6 tempest-VolumesSnapshotTestJSON-819713234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:20:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e20ca77b-15f1-4f27-8ef4-49386d48d3b6 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e20ca77b-15f1-4f27-8ef4-49386d48d3b6 tempest-VolumesSnapshotTestJSON-819713234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:25 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:20:25 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:25 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e20ca77b-15f1-4f27-8ef4-49386d48d3b6 tempest-VolumesSnapshotTestJSON-819713234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.636s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:25 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-e20ca77b-15f1-4f27-8ef4-49386d48d3b6 tempest-VolumesSnapshotTestJSON-819713234 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:20:25 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-e20ca77b-15f1-4f27-8ef4-49386d48d3b6 tempest-VolumesSnapshotTestJSON-819713234 None] Deleted volume successfully. Sep 09 18:20:25 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e20ca77b-15f1-4f27-8ef4-49386d48d3b6 tempest-VolumesSnapshotTestJSON-819713234 None] Lock "cinder-b6f69172-9e4b-45e3-867b-16051676ceaf-delete_volume" released by "delete_volume" :: held 3.490s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:28 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5bfae0c9-0d1a-4148-90af-149c3ef72f0e" returned: 0 in 6.312s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:28 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Image conversion details: src /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1, size 1024.00 MB, duration 6.31 sec, destination /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5bfae0c9-0d1a-4148-90af-149c3ef72f0e {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:20:28 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Converted 1024.00 MB image at 162.21 MB/s Sep 09 18:20:28 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5bfae0c9-0d1a-4148-90af-149c3ef72f0e is being set with open permissions: ugo+rw Sep 09 18:20:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5bfae0c9-0d1a-4148-90af-149c3ef72f0e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:28 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5bfae0c9-0d1a-4148-90af-149c3ef72f0e Sep 09 18:20:28 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:28 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5bfae0c9-0d1a-4148-90af-149c3ef72f0e" returned: 0 in 0.316s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:28 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-quobyte-5bfae0c9-0d1a-4148-90af-149c3ef72f0e" released by "_copy_volume_from_snapshot" :: held 7.951s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:28 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-quobyte-aebcf594-7506-4c75-b032-23cce63c8dc7-5bfae0c9-0d1a-4148-90af-149c3ef72f0e" released by "_create_volume_from_snapshot" :: held 8.093s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.150s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce03470a-af7f-4e4a-bb78-7da086e091e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bfae0c9-0d1a-4148-90af-149c3ef72f0e', 'volume_size': 1, 'snapshot_id': 'aebcf594-7506-4c75-b032-23cce63c8dc7'}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8848a1c0-101a-459d-8a7a-893afaeaa959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:28 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Volume volume-5bfae0c9-0d1a-4148-90af-149c3ef72f0e (5bfae0c9-0d1a-4148-90af-149c3ef72f0e): created successfully Sep 09 18:20:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8848a1c0-101a-459d-8a7a-893afaeaa959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Flow 'volume_create_manager' (349262fd-7326-4f0e-9a36-1606b158f1ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:20:28 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-41f0c40b-a3e6-4357-8497-c9a9c56a8c82 tempest-VolumesDeleteCascade-751898372 None] Created volume successfully. Sep 09 18:20:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "cinder-51deb400-ea28-4498-848b-43345ef9c6f1-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-51deb400-ea28-4498-848b-43345ef9c6f1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Performing cascade delete. {{(pid=87639) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 09 18:20:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "cinder-aebcf594-7506-4c75-b032-23cce63c8dc7-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-aebcf594-7506-4c75-b032-23cce63c8dc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "cinder-quobyte-51deb400-ea28-4498-848b-43345ef9c6f1" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-quobyte-51deb400-ea28-4498-848b-43345ef9c6f1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "cinder-quobyte-aebcf594-7506-4c75-b032-23cce63c8dc7" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-quobyte-aebcf594-7506-4c75-b032-23cce63c8dc7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Deleting offline snapshot aebcf594-7506-4c75-b032-23cce63c8dc7 of volume 51deb400-ea28-4498-848b-43345ef9c6f1 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:20:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] snapshot_file for this snap is: volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:20:29 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ac8a39-ba7c-44f0-8575-54c36c005edd]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:29 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7 Sep 09 18:20:29 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:29 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7" returned: 0 in 0.447s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51deb400-ea28-4498-848b-43345ef9c6f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:20:29 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebd2cf5-cc04-4397-a669-a1334e0956f7]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:29 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1 Sep 09 18:20:29 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:30 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1" returned: 0 in 0.547s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:30 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7 Sep 09 18:20:30 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:30 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7" returned: 0 in 0.425s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:30 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7 Sep 09 18:20:30 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:31 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1.aebcf594-7506-4c75-b032-23cce63c8dc7" returned: 0 in 0.260s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-quobyte-aebcf594-7506-4c75-b032-23cce63c8dc7" released by "_delete_snapshot" :: held 1.796s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-quobyte-51deb400-ea28-4498-848b-43345ef9c6f1" released by "delete_snapshot" :: held 1.825s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:31 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Created reservations ['745f2ab4-2276-4d46-aee5-2aa390d004d1', '470d3489-4157-4eea-8cdd-3e5efb2848d0', '5fcd702f-241e-4e8f-9cad-1df3f7a19ce2', 'a2853d7b-c2ff-495b-a33e-1a0246c2dc57'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:20:31 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Delete snapshot completed successfully. Sep 09 18:20:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-aebcf594-7506-4c75-b032-23cce63c8dc7-delete_snapshot" released by "delete_snapshot" :: held 2.017s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Snapshots deleted, issuing volume delete {{(pid=87639) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 09 18:20:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "cinder-quobyte-51deb400-ea28-4498-848b-43345ef9c6f1" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-quobyte-51deb400-ea28-4498-848b-43345ef9c6f1" acquired by "delete_volume" :: waited 0.022s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:31 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[78eff415-0ed1-45c3-8e9a-967bf8c0cbe8]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:31 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1 Sep 09 18:20:31 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:31 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1" returned: 0 in 0.383s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:31 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1 Sep 09 18:20:31 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:31 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-51deb400-ea28-4498-848b-43345ef9c6f1" returned: 0 in 0.318s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-quobyte-51deb400-ea28-4498-848b-43345ef9c6f1" released by "delete_volume" :: held 0.787s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:32 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Created reservations ['b527f4f3-d48f-4e35-be0d-b79e2c0ac6bf', 'f4d23bf9-7e35-4d36-85b5-621aa0a337e5', '6b05f508-2b66-4a37-bdd9-767b3c356306', 'b4cce8f6-a7a4-4e2a-8e4f-6744993015ab'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:20:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:20:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:20:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:32 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:20:32 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:32 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.266s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:32 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:20:32 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Deleted volume successfully. Sep 09 18:20:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bef83f51-f2f6-4ab2-85e4-a10abac68a33 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-51deb400-ea28-4498-848b-43345ef9c6f1-delete_volume" released by "delete_volume" :: held 3.372s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-cd092295-d567-4e0f-b177-098b5147cd00 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "cinder-5bfae0c9-0d1a-4148-90af-149c3ef72f0e-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-cd092295-d567-4e0f-b177-098b5147cd00 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-5bfae0c9-0d1a-4148-90af-149c3ef72f0e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-cd092295-d567-4e0f-b177-098b5147cd00 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "cinder-quobyte-5bfae0c9-0d1a-4148-90af-149c3ef72f0e" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-cd092295-d567-4e0f-b177-098b5147cd00 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-quobyte-5bfae0c9-0d1a-4148-90af-149c3ef72f0e" acquired by "delete_volume" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:32 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0512793-e0d1-4ce3-b25f-620d0fe82e7a]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cd092295-d567-4e0f-b177-098b5147cd00 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5bfae0c9-0d1a-4148-90af-149c3ef72f0e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:32 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5bfae0c9-0d1a-4148-90af-149c3ef72f0e Sep 09 18:20:32 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:33 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cd092295-d567-4e0f-b177-098b5147cd00 tempest-VolumesDeleteCascade-751898372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5bfae0c9-0d1a-4148-90af-149c3ef72f0e" returned: 0 in 0.632s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cd092295-d567-4e0f-b177-098b5147cd00 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5bfae0c9-0d1a-4148-90af-149c3ef72f0e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:33 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5bfae0c9-0d1a-4148-90af-149c3ef72f0e Sep 09 18:20:33 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:33 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cd092295-d567-4e0f-b177-098b5147cd00 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5bfae0c9-0d1a-4148-90af-149c3ef72f0e" returned: 0 in 0.464s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-cd092295-d567-4e0f-b177-098b5147cd00 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-quobyte-5bfae0c9-0d1a-4148-90af-149c3ef72f0e" released by "delete_volume" :: held 1.165s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:33 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-cd092295-d567-4e0f-b177-098b5147cd00 tempest-VolumesDeleteCascade-751898372 None] Created reservations ['f040bbdd-5651-467a-9545-1c2ef40d321d', 'd7ff75a0-b975-4240-b62f-21a6c10c0121', '712064da-2597-4cf9-a0ab-2cb1d869c133', '7693b756-4aa8-4115-a282-0e2ea0bf0a73'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:20:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cd092295-d567-4e0f-b177-098b5147cd00 tempest-VolumesDeleteCascade-751898372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cd092295-d567-4e0f-b177-098b5147cd00 tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cd092295-d567-4e0f-b177-098b5147cd00 tempest-VolumesDeleteCascade-751898372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:20:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cd092295-d567-4e0f-b177-098b5147cd00 tempest-VolumesDeleteCascade-751898372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:20:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cd092295-d567-4e0f-b177-098b5147cd00 tempest-VolumesDeleteCascade-751898372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cd092295-d567-4e0f-b177-098b5147cd00 tempest-VolumesDeleteCascade-751898372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:34 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:20:34 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:34 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cd092295-d567-4e0f-b177-098b5147cd00 tempest-VolumesDeleteCascade-751898372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.674s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:34 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cd092295-d567-4e0f-b177-098b5147cd00 tempest-VolumesDeleteCascade-751898372 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:20:34 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-cd092295-d567-4e0f-b177-098b5147cd00 tempest-VolumesDeleteCascade-751898372 None] Deleted volume successfully. Sep 09 18:20:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-cd092295-d567-4e0f-b177-098b5147cd00 tempest-VolumesDeleteCascade-751898372 None] Lock "cinder-5bfae0c9-0d1a-4148-90af-149c3ef72f0e-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-53f8037c-5113-4c29-a8da-aee68a8ec0fa tempest-VolumesActionsTest-55346329 None] Acquiring lock "cinder-5440ff22-25fc-46df-b2f4-6ce5e052fc95" by "attach_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-53f8037c-5113-4c29-a8da-aee68a8ec0fa tempest-VolumesActionsTest-55346329 None] Lock "cinder-5440ff22-25fc-46df-b2f4-6ce5e052fc95" acquired by "attach_volume" :: waited 0.046s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:36 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-53f8037c-5113-4c29-a8da-aee68a8ec0fa tempest-VolumesActionsTest-55346329 None] Attaching volume 5440ff22-25fc-46df-b2f4-6ce5e052fc95 to instance 31e02a7e-50b3-49e6-8127-2f3363213059 at mountpoint /dev/vdb on host None. Sep 09 18:20:37 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-53f8037c-5113-4c29-a8da-aee68a8ec0fa tempest-VolumesActionsTest-55346329 None] Attach volume completed successfully. Sep 09 18:20:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-53f8037c-5113-4c29-a8da-aee68a8ec0fa tempest-VolumesActionsTest-55346329 None] Lock "cinder-5440ff22-25fc-46df-b2f4-6ce5e052fc95" released by "attach_volume" :: held 0.200s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-cc6baf0e-e2e0-4686-be45-8400b395facb tempest-VolumesActionsTest-55346329 None] Acquiring lock "cinder-5440ff22-25fc-46df-b2f4-6ce5e052fc95-detach_volume" by "detach_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-cc6baf0e-e2e0-4686-be45-8400b395facb tempest-VolumesActionsTest-55346329 None] Lock "cinder-5440ff22-25fc-46df-b2f4-6ce5e052fc95-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:37 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-cc6baf0e-e2e0-4686-be45-8400b395facb tempest-VolumesActionsTest-55346329 None] Detaching volume 5440ff22-25fc-46df-b2f4-6ce5e052fc95 from instance 31e02a7e-50b3-49e6-8127-2f3363213059. Sep 09 18:20:37 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-cc6baf0e-e2e0-4686-be45-8400b395facb tempest-VolumesActionsTest-55346329 None] Detach volume completed successfully. Sep 09 18:20:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-cc6baf0e-e2e0-4686-be45-8400b395facb tempest-VolumesActionsTest-55346329 None] Lock "cinder-5440ff22-25fc-46df-b2f4-6ce5e052fc95-detach_volume" released by "detach_volume" :: held 0.078s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:39 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:20:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Flow 'volume_create_manager' (5ad48ba4-beed-40c1-9b1b-0818e67ab842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:20:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (012b7b6c-a17c-48ec-b601-2df7f05256cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (012b7b6c-a17c-48ec-b601-2df7f05256cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-143645523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadd2841-9821-4f18-8137-5fa85cfb03fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f73b277124a6468981693f58a9af5a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:20:40Z,use_quota=True,user_id='43d9fef71c2144839389bd803bb3c007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4458c8cd-1480-472b-bbbb-ca591a7426b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4458c8cd-1480-472b-bbbb-ca591a7426b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69084212-702c-4822-b71a-4b49d022caf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69084212-702c-4822-b71a-4b49d022caf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fadd2841-9821-4f18-8137-5fa85cfb03fa', 'volume_name': 'volume-fadd2841-9821-4f18-8137-5fa85cfb03fa', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7c2fd9-cd58-4e65-b304-a8e0a32cbfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7c2fd9-cd58-4e65-b304-a8e0a32cbfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e537b1-5e1e-4573-8223-f7fd931ea358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:39 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Volume fadd2841-9821-4f18-8137-5fa85cfb03fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fadd2841-9821-4f18-8137-5fa85cfb03fa', 'volume_size': 1} Sep 09 18:20:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-143645523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadd2841-9821-4f18-8137-5fa85cfb03fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f73b277124a6468981693f58a9af5a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:20:40Z,use_quota=True,user_id='43d9fef71c2144839389bd803bb3c007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:20:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Creating volume fadd2841-9821-4f18-8137-5fa85cfb03fa {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:20:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:20:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:20:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:20:39 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:20:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:39 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa 1073741824 Sep 09 18:20:39 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:40 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa 1073741824" returned: 0 in 0.636s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:40 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa Sep 09 18:20:40 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Flow 'volume_create_manager' (7bdd4a29-5e79-4640-b039-31d12e0dd911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e17745-0370-4605-92df-7d7a0be1f2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e17745-0370-4605-92df-7d7a0be1f2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-228621378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45cf4b6f-a85b-4796-a0c4-853bc697cc3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f66f9b358f45379acb29665fdca6ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:20:41Z,use_quota=True,user_id='96679c85eb4049dd8331b10548591c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20f89f0-97d3-4634-bc57-2a15fb9e8fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20f89f0-97d3-4634-bc57-2a15fb9e8fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (969a8bde-41c9-4c98-876d-e124d88fbfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (969a8bde-41c9-4c98-876d-e124d88fbfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45cf4b6f-a85b-4796-a0c4-853bc697cc3a', 'volume_name': 'volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1cc0af1-3212-4824-a948-c5392fab2e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1cc0af1-3212-4824-a948-c5392fab2e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d5a342-246c-48f8-9b64-b98868b2234c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:40 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Volume 45cf4b6f-a85b-4796-a0c4-853bc697cc3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a', 'volume_size': 1} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:40 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa" returned: 0 in 0.289s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.047s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-228621378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45cf4b6f-a85b-4796-a0c4-853bc697cc3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90f66f9b358f45379acb29665fdca6ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:20:41Z,use_quota=True,user_id='96679c85eb4049dd8331b10548591c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Creating volume 45cf4b6f-a85b-4796-a0c4-853bc697cc3a {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:20:40 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:40 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a 1073741824 Sep 09 18:20:40 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e537b1-5e1e-4573-8223-f7fd931ea358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fadd2841-9821-4f18-8137-5fa85cfb03fa', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c48fb4a5-9c25-4185-91fb-b3939b54ff6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:40 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Volume volume-fadd2841-9821-4f18-8137-5fa85cfb03fa (fadd2841-9821-4f18-8137-5fa85cfb03fa): created successfully Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c48fb4a5-9c25-4185-91fb-b3939b54ff6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Flow 'volume_create_manager' (5ad48ba4-beed-40c1-9b1b-0818e67ab842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:20:40 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-d2938390-d94b-4fa1-b21e-37f3c0820552 req-bad25592-94e8-4da1-8a5a-7e6dbe1e953e tempest-VolumesSnapshotsTestJSON-1033668188 None] Created volume successfully. Sep 09 18:20:41 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a 1073741824" returned: 0 in 0.508s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:41 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a Sep 09 18:20:41 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:41 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a" returned: 0 in 0.272s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:41 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:20:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:41 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d5a342-246c-48f8-9b64-b98868b2234c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:41 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1f7f6b-2b53-468d-9751-f3c5075bbc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:41 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Volume volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a (45cf4b6f-a85b-4796-a0c4-853bc697cc3a): created successfully Sep 09 18:20:41 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1f7f6b-2b53-468d-9751-f3c5075bbc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:41 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Flow 'volume_create_manager' (7bdd4a29-5e79-4640-b039-31d12e0dd911) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:20:41 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-fd012ba0-3804-4a5a-b40f-23555153b8db tempest-VolumesSnapshotListTestJSON-1265411180 None] Created volume successfully. Sep 09 18:20:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-bbd72eea-e03c-419e-abad-1198efcbb23b req-1d08cdde-3885-4857-9a04-56efa13e1d1b tempest-VolumesSnapshotsTestJSON-1033668188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-bbd72eea-e03c-419e-abad-1198efcbb23b req-1d08cdde-3885-4857-9a04-56efa13e1d1b tempest-VolumesSnapshotsTestJSON-1033668188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [req-bbd72eea-e03c-419e-abad-1198efcbb23b req-1d08cdde-3885-4857-9a04-56efa13e1d1b tempest-VolumesSnapshotsTestJSON-1033668188 None] Creating offline snapshot f2da2628-00ff-42d7-8680-667e4b045860 of volume fadd2841-9821-4f18-8137-5fa85cfb03fa {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:20:42 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0174428d-9d83-448d-a4ff-b6073f99ef41]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-bbd72eea-e03c-419e-abad-1198efcbb23b req-1d08cdde-3885-4857-9a04-56efa13e1d1b tempest-VolumesSnapshotsTestJSON-1033668188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:42 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa Sep 09 18:20:42 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:42 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-bbd72eea-e03c-419e-abad-1198efcbb23b req-1d08cdde-3885-4857-9a04-56efa13e1d1b tempest-VolumesSnapshotsTestJSON-1033668188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa" returned: 0 in 0.431s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-bbd72eea-e03c-419e-abad-1198efcbb23b req-1d08cdde-3885-4857-9a04-56efa13e1d1b tempest-VolumesSnapshotsTestJSON-1033668188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.f2da2628-00ff-42d7-8680-667e4b045860 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:42 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.f2da2628-00ff-42d7-8680-667e4b045860 1G Sep 09 18:20:42 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-59f591ee-798a-4c03-bb6d-89b3b6c47b47 tempest-VolumesActionsTest-55346329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:43 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-bbd72eea-e03c-419e-abad-1198efcbb23b req-1d08cdde-3885-4857-9a04-56efa13e1d1b tempest-VolumesSnapshotsTestJSON-1033668188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.f2da2628-00ff-42d7-8680-667e4b045860 1G" returned: 0 in 0.513s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-bbd72eea-e03c-419e-abad-1198efcbb23b req-1d08cdde-3885-4857-9a04-56efa13e1d1b tempest-VolumesSnapshotsTestJSON-1033668188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fadd2841-9821-4f18-8137-5fa85cfb03fa -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.f2da2628-00ff-42d7-8680-667e4b045860 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3959a4ab-a67f-4b75-a7db-33fedffb0bb6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:43 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fadd2841-9821-4f18-8137-5fa85cfb03fa -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.f2da2628-00ff-42d7-8680-667e4b045860 Sep 09 18:20:43 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:43 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:20:43 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:43 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-bbd72eea-e03c-419e-abad-1198efcbb23b req-1d08cdde-3885-4857-9a04-56efa13e1d1b tempest-VolumesSnapshotsTestJSON-1033668188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fadd2841-9821-4f18-8137-5fa85cfb03fa -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.f2da2628-00ff-42d7-8680-667e4b045860" returned: 0 in 0.329s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:43 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [req-bbd72eea-e03c-419e-abad-1198efcbb23b req-1d08cdde-3885-4857-9a04-56efa13e1d1b tempest-VolumesSnapshotsTestJSON-1033668188 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.f2da2628-00ff-42d7-8680-667e4b045860 is being set with open permissions: ugo+rw Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-bbd72eea-e03c-419e-abad-1198efcbb23b req-1d08cdde-3885-4857-9a04-56efa13e1d1b tempest-VolumesSnapshotsTestJSON-1033668188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.f2da2628-00ff-42d7-8680-667e4b045860 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:43 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.f2da2628-00ff-42d7-8680-667e4b045860 Sep 09 18:20:43 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Flow 'volume_create_manager' (118e2978-aeff-43f6-bcad-7100f286d7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f643f09-e3ae-4f3d-bd43-58e9f8e230d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f643f09-e3ae-4f3d-bd43-58e9f8e230d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1467504909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0861bdbe-e294-4e14-a9b3-c24849190f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d8a2c248cc43d4a51705dbaa3f08c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:20:43Z,use_quota=True,user_id='a0feeb310e3947bfa19af7bbe411d183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b57fc5a-d22e-4f9a-839b-99312e777f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b57fc5a-d22e-4f9a-839b-99312e777f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be80022-25c4-4f87-9a5e-8bbf3247e894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be80022-25c4-4f87-9a5e-8bbf3247e894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0861bdbe-e294-4e14-a9b3-c24849190f60', 'volume_name': 'volume-0861bdbe-e294-4e14-a9b3-c24849190f60', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:43 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35679bc1-8df6-415b-b0e6-b0699adaaea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35679bc1-8df6-415b-b0e6-b0699adaaea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b120a5-6443-47f8-b9cc-f5158f2b5fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:43 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Volume 0861bdbe-e294-4e14-a9b3-c24849190f60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0861bdbe-e294-4e14-a9b3-c24849190f60', 'volume_size': 1} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.311s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 29 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:20:43 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-bbd72eea-e03c-419e-abad-1198efcbb23b req-1d08cdde-3885-4857-9a04-56efa13e1d1b tempest-VolumesSnapshotsTestJSON-1033668188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.f2da2628-00ff-42d7-8680-667e4b045860" returned: 0 in 0.252s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-bbd72eea-e03c-419e-abad-1198efcbb23b req-1d08cdde-3885-4857-9a04-56efa13e1d1b tempest-VolumesSnapshotsTestJSON-1033668188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:43 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.info Sep 09 18:20:43 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:43 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-bbd72eea-e03c-419e-abad-1198efcbb23b req-1d08cdde-3885-4857-9a04-56efa13e1d1b tempest-VolumesSnapshotsTestJSON-1033668188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.info" returned: 0 in 0.241s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:43 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [req-bbd72eea-e03c-419e-abad-1198efcbb23b req-1d08cdde-3885-4857-9a04-56efa13e1d1b tempest-VolumesSnapshotsTestJSON-1033668188 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.info is being set with open permissions: ugo+rw Sep 09 18:20:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-bbd72eea-e03c-419e-abad-1198efcbb23b req-1d08cdde-3885-4857-9a04-56efa13e1d1b tempest-VolumesSnapshotsTestJSON-1033668188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:43 devstack sudo[98934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.info Sep 09 18:20:43 devstack sudo[98934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:44 devstack sudo[98934]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-bbd72eea-e03c-419e-abad-1198efcbb23b req-1d08cdde-3885-4857-9a04-56efa13e1d1b tempest-VolumesSnapshotsTestJSON-1033668188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.info" returned: 0 in 0.242s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-bbd72eea-e03c-419e-abad-1198efcbb23b req-1d08cdde-3885-4857-9a04-56efa13e1d1b tempest-VolumesSnapshotsTestJSON-1033668188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.102s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-59f591ee-798a-4c03-bb6d-89b3b6c47b47 tempest-VolumesActionsTest-55346329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.360s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:44 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3a4900-a66c-445d-97d0-b50c621280c4]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-59f591ee-798a-4c03-bb6d-89b3b6c47b47 tempest-VolumesActionsTest-55346329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:44 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-bbd72eea-e03c-419e-abad-1198efcbb23b req-1d08cdde-3885-4857-9a04-56efa13e1d1b tempest-VolumesSnapshotsTestJSON-1033668188 None] Create snapshot completed successfully Sep 09 18:20:44 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 Sep 09 18:20:44 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:44 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-59f591ee-798a-4c03-bb6d-89b3b6c47b47 tempest-VolumesActionsTest-55346329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95" returned: 0 in 0.352s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:44 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b930a4c-4077-4ea4-ab33-7a91125731cb]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-59f591ee-798a-4c03-bb6d-89b3b6c47b47 tempest-VolumesActionsTest-55346329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:44 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 Sep 09 18:20:44 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-a3410768-75ef-46df-b38a-33032ca34549 req-d1759f15-49cd-4e26-a4bf-89d148f2ba4b tempest-VolumesSnapshotsTestJSON-1033668188 None] Acquiring lock "cinder-f2da2628-00ff-42d7-8680-667e4b045860-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-a3410768-75ef-46df-b38a-33032ca34549 req-d1759f15-49cd-4e26-a4bf-89d148f2ba4b tempest-VolumesSnapshotsTestJSON-1033668188 None] Lock "cinder-f2da2628-00ff-42d7-8680-667e4b045860-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-a3410768-75ef-46df-b38a-33032ca34549 req-d1759f15-49cd-4e26-a4bf-89d148f2ba4b tempest-VolumesSnapshotsTestJSON-1033668188 None] Acquiring lock "cinder-quobyte-fadd2841-9821-4f18-8137-5fa85cfb03fa" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-a3410768-75ef-46df-b38a-33032ca34549 req-d1759f15-49cd-4e26-a4bf-89d148f2ba4b tempest-VolumesSnapshotsTestJSON-1033668188 None] Lock "cinder-quobyte-fadd2841-9821-4f18-8137-5fa85cfb03fa" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-a3410768-75ef-46df-b38a-33032ca34549 req-d1759f15-49cd-4e26-a4bf-89d148f2ba4b tempest-VolumesSnapshotsTestJSON-1033668188 None] Acquiring lock "cinder-quobyte-f2da2628-00ff-42d7-8680-667e4b045860" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-a3410768-75ef-46df-b38a-33032ca34549 req-d1759f15-49cd-4e26-a4bf-89d148f2ba4b tempest-VolumesSnapshotsTestJSON-1033668188 None] Lock "cinder-quobyte-f2da2628-00ff-42d7-8680-667e4b045860" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:44 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [req-a3410768-75ef-46df-b38a-33032ca34549 req-d1759f15-49cd-4e26-a4bf-89d148f2ba4b tempest-VolumesSnapshotsTestJSON-1033668188 None] Deleting offline snapshot f2da2628-00ff-42d7-8680-667e4b045860 of volume fadd2841-9821-4f18-8137-5fa85cfb03fa {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:20:44 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [req-a3410768-75ef-46df-b38a-33032ca34549 req-d1759f15-49cd-4e26-a4bf-89d148f2ba4b tempest-VolumesSnapshotsTestJSON-1033668188 None] snapshot_file for this snap is: volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.f2da2628-00ff-42d7-8680-667e4b045860 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:20:44 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee8237f-189b-4fc1-846f-660f38f3def9]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-a3410768-75ef-46df-b38a-33032ca34549 req-d1759f15-49cd-4e26-a4bf-89d148f2ba4b tempest-VolumesSnapshotsTestJSON-1033668188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.f2da2628-00ff-42d7-8680-667e4b045860 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:44 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-59f591ee-798a-4c03-bb6d-89b3b6c47b47 tempest-VolumesActionsTest-55346329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95" returned: 0 in 0.417s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-59f591ee-798a-4c03-bb6d-89b3b6c47b47 tempest-VolumesActionsTest-55346329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 /opt/stack/data/cinder/conversion/5440ff22-25fc-46df-b2f4-6ce5e052fc95.temp_image.a469e49d-c36d-4e52-94d8-b00992ae5581yy_2cs1z.img {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:44 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 /opt/stack/data/cinder/conversion/5440ff22-25fc-46df-b2f4-6ce5e052fc95.temp_image.a469e49d-c36d-4e52-94d8-b00992ae5581yy_2cs1z.img Sep 09 18:20:44 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:45 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.f2da2628-00ff-42d7-8680-667e4b045860 Sep 09 18:20:45 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:45 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-a3410768-75ef-46df-b38a-33032ca34549 req-d1759f15-49cd-4e26-a4bf-89d148f2ba4b tempest-VolumesSnapshotsTestJSON-1033668188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.f2da2628-00ff-42d7-8680-667e4b045860" returned: 0 in 0.486s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [req-a3410768-75ef-46df-b38a-33032ca34549 req-d1759f15-49cd-4e26-a4bf-89d148f2ba4b tempest-VolumesSnapshotsTestJSON-1033668188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fadd2841-9821-4f18-8137-5fa85cfb03fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:20:45 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1619c4f-68d8-458f-ace0-0fa0277590b6]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-a3410768-75ef-46df-b38a-33032ca34549 req-d1759f15-49cd-4e26-a4bf-89d148f2ba4b tempest-VolumesSnapshotsTestJSON-1033668188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:45 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa Sep 09 18:20:45 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:46 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-a3410768-75ef-46df-b38a-33032ca34549 req-d1759f15-49cd-4e26-a4bf-89d148f2ba4b tempest-VolumesSnapshotsTestJSON-1033668188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa" returned: 0 in 0.730s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-a3410768-75ef-46df-b38a-33032ca34549 req-d1759f15-49cd-4e26-a4bf-89d148f2ba4b tempest-VolumesSnapshotsTestJSON-1033668188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.f2da2628-00ff-42d7-8680-667e4b045860 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:46 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.f2da2628-00ff-42d7-8680-667e4b045860 Sep 09 18:20:46 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:47 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-a3410768-75ef-46df-b38a-33032ca34549 req-d1759f15-49cd-4e26-a4bf-89d148f2ba4b tempest-VolumesSnapshotsTestJSON-1033668188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.f2da2628-00ff-42d7-8680-667e4b045860" returned: 0 in 0.805s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-a3410768-75ef-46df-b38a-33032ca34549 req-d1759f15-49cd-4e26-a4bf-89d148f2ba4b tempest-VolumesSnapshotsTestJSON-1033668188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.f2da2628-00ff-42d7-8680-667e4b045860 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:47 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.f2da2628-00ff-42d7-8680-667e4b045860 Sep 09 18:20:47 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:47 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-a3410768-75ef-46df-b38a-33032ca34549 req-d1759f15-49cd-4e26-a4bf-89d148f2ba4b tempest-VolumesSnapshotsTestJSON-1033668188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa.f2da2628-00ff-42d7-8680-667e4b045860" returned: 0 in 0.976s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-a3410768-75ef-46df-b38a-33032ca34549 req-d1759f15-49cd-4e26-a4bf-89d148f2ba4b tempest-VolumesSnapshotsTestJSON-1033668188 None] Lock "cinder-quobyte-f2da2628-00ff-42d7-8680-667e4b045860" released by "_delete_snapshot" :: held 3.211s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-a3410768-75ef-46df-b38a-33032ca34549 req-d1759f15-49cd-4e26-a4bf-89d148f2ba4b tempest-VolumesSnapshotsTestJSON-1033668188 None] Lock "cinder-quobyte-fadd2841-9821-4f18-8137-5fa85cfb03fa" released by "delete_snapshot" :: held 3.247s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:48 devstack cinder-volume[87639]: DEBUG cinder.quota [req-a3410768-75ef-46df-b38a-33032ca34549 req-d1759f15-49cd-4e26-a4bf-89d148f2ba4b tempest-VolumesSnapshotsTestJSON-1033668188 None] Created reservations ['881a3a2b-dcee-4118-9e8f-d9143a182fa4', 'cbaeb5d1-f145-4ce0-bc31-0f3bd27585dc', '1665bfad-4e5a-40fe-b251-a85a1501b526', '923c268b-d6e0-4316-afe7-d030f0856e99'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:20:48 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-a3410768-75ef-46df-b38a-33032ca34549 req-d1759f15-49cd-4e26-a4bf-89d148f2ba4b tempest-VolumesSnapshotsTestJSON-1033668188 None] Delete snapshot completed successfully. Sep 09 18:20:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-a3410768-75ef-46df-b38a-33032ca34549 req-d1759f15-49cd-4e26-a4bf-89d148f2ba4b tempest-VolumesSnapshotsTestJSON-1033668188 None] Lock "cinder-f2da2628-00ff-42d7-8680-667e4b045860-delete_snapshot" released by "delete_snapshot" :: held 3.538s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-9977ad68-bfae-43a6-a0a8-b69d963f88aa req-81c5907c-cfbd-4362-84e6-ef612c55e092 tempest-VolumesSnapshotsTestJSON-1033668188 None] Acquiring lock "cinder-fadd2841-9821-4f18-8137-5fa85cfb03fa-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-9977ad68-bfae-43a6-a0a8-b69d963f88aa req-81c5907c-cfbd-4362-84e6-ef612c55e092 tempest-VolumesSnapshotsTestJSON-1033668188 None] Lock "cinder-fadd2841-9821-4f18-8137-5fa85cfb03fa-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-9977ad68-bfae-43a6-a0a8-b69d963f88aa req-81c5907c-cfbd-4362-84e6-ef612c55e092 tempest-VolumesSnapshotsTestJSON-1033668188 None] Acquiring lock "cinder-quobyte-fadd2841-9821-4f18-8137-5fa85cfb03fa" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:20:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-9977ad68-bfae-43a6-a0a8-b69d963f88aa req-81c5907c-cfbd-4362-84e6-ef612c55e092 tempest-VolumesSnapshotsTestJSON-1033668188 None] Lock "cinder-quobyte-fadd2841-9821-4f18-8137-5fa85cfb03fa" acquired by "delete_volume" :: waited 0.029s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:20:48 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d600d0-a04b-4994-9a42-e2f4a4216463]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-9977ad68-bfae-43a6-a0a8-b69d963f88aa req-81c5907c-cfbd-4362-84e6-ef612c55e092 tempest-VolumesSnapshotsTestJSON-1033668188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:49 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa Sep 09 18:20:49 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:49 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-59f591ee-798a-4c03-bb6d-89b3b6c47b47 tempest-VolumesActionsTest-55346329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 /opt/stack/data/cinder/conversion/5440ff22-25fc-46df-b2f4-6ce5e052fc95.temp_image.a469e49d-c36d-4e52-94d8-b00992ae5581yy_2cs1z.img" returned: 0 in 4.530s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:49 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd6a42d-b26a-41c7-b9b1-77f08ee92dc5]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:20:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-59f591ee-798a-4c03-bb6d-89b3b6c47b47 tempest-VolumesActionsTest-55346329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:49 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-9977ad68-bfae-43a6-a0a8-b69d963f88aa req-81c5907c-cfbd-4362-84e6-ef612c55e092 tempest-VolumesSnapshotsTestJSON-1033668188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa" returned: 0 in 0.679s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-9977ad68-bfae-43a6-a0a8-b69d963f88aa req-81c5907c-cfbd-4362-84e6-ef612c55e092 tempest-VolumesSnapshotsTestJSON-1033668188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:49 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa Sep 09 18:20:49 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:49 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 Sep 09 18:20:49 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:49 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-9977ad68-bfae-43a6-a0a8-b69d963f88aa req-81c5907c-cfbd-4362-84e6-ef612c55e092 tempest-VolumesSnapshotsTestJSON-1033668188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fadd2841-9821-4f18-8137-5fa85cfb03fa" returned: 0 in 0.233s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-9977ad68-bfae-43a6-a0a8-b69d963f88aa req-81c5907c-cfbd-4362-84e6-ef612c55e092 tempest-VolumesSnapshotsTestJSON-1033668188 None] Lock "cinder-quobyte-fadd2841-9821-4f18-8137-5fa85cfb03fa" released by "delete_volume" :: held 1.044s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:49 devstack cinder-volume[87639]: DEBUG cinder.quota [req-9977ad68-bfae-43a6-a0a8-b69d963f88aa req-81c5907c-cfbd-4362-84e6-ef612c55e092 tempest-VolumesSnapshotsTestJSON-1033668188 None] Created reservations ['40ec2743-39cd-4d48-85d1-bbfec65fe7e7', 'a4c7835f-acbb-4081-99d0-eddcde72ddba', '4af74389-58f4-4372-8fa4-319251a20e42', '55695469-f1b1-4ac7-8cde-1b37283fbfa0'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:20:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-9977ad68-bfae-43a6-a0a8-b69d963f88aa req-81c5907c-cfbd-4362-84e6-ef612c55e092 tempest-VolumesSnapshotsTestJSON-1033668188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:20:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-9977ad68-bfae-43a6-a0a8-b69d963f88aa req-81c5907c-cfbd-4362-84e6-ef612c55e092 tempest-VolumesSnapshotsTestJSON-1033668188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:20:49 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [req-9977ad68-bfae-43a6-a0a8-b69d963f88aa req-81c5907c-cfbd-4362-84e6-ef612c55e092 tempest-VolumesSnapshotsTestJSON-1033668188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:20:49 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [req-9977ad68-bfae-43a6-a0a8-b69d963f88aa req-81c5907c-cfbd-4362-84e6-ef612c55e092 tempest-VolumesSnapshotsTestJSON-1033668188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:20:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-9977ad68-bfae-43a6-a0a8-b69d963f88aa req-81c5907c-cfbd-4362-84e6-ef612c55e092 tempest-VolumesSnapshotsTestJSON-1033668188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:20:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-9977ad68-bfae-43a6-a0a8-b69d963f88aa req-81c5907c-cfbd-4362-84e6-ef612c55e092 tempest-VolumesSnapshotsTestJSON-1033668188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:20:49 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:20:49 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:20:49 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-59f591ee-798a-4c03-bb6d-89b3b6c47b47 tempest-VolumesActionsTest-55346329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95" returned: 0 in 0.513s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:49 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-59f591ee-798a-4c03-bb6d-89b3b6c47b47 tempest-VolumesActionsTest-55346329 None] Image conversion details: src /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95, size 1024.00 MB, duration 4.53 sec, destination /opt/stack/data/cinder/conversion/5440ff22-25fc-46df-b2f4-6ce5e052fc95.temp_image.a469e49d-c36d-4e52-94d8-b00992ae5581yy_2cs1z.img {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:20:50 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-59f591ee-798a-4c03-bb6d-89b3b6c47b47 tempest-VolumesActionsTest-55346329 None] Converted 1024.00 MB image at 226.01 MB/s Sep 09 18:20:50 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-59f591ee-798a-4c03-bb6d-89b3b6c47b47 tempest-VolumesActionsTest-55346329 None] a469e49d-c36d-4e52-94d8-b00992ae5581 was raw, no need to convert to raw {{(pid=87639) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 09 18:20:50 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Sep 09 18:20:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-9977ad68-bfae-43a6-a0a8-b69d963f88aa req-81c5907c-cfbd-4362-84e6-ef612c55e092 tempest-VolumesSnapshotsTestJSON-1033668188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.256s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:20:50 devstack cinder-volume[87639]: DEBUG cinder.manager [req-9977ad68-bfae-43a6-a0a8-b69d963f88aa req-81c5907c-cfbd-4362-84e6-ef612c55e092 tempest-VolumesSnapshotsTestJSON-1033668188 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:20:50 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-9977ad68-bfae-43a6-a0a8-b69d963f88aa req-81c5907c-cfbd-4362-84e6-ef612c55e092 tempest-VolumesSnapshotsTestJSON-1033668188 None] Deleted volume successfully. Sep 09 18:20:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-9977ad68-bfae-43a6-a0a8-b69d963f88aa req-81c5907c-cfbd-4362-84e6-ef612c55e092 tempest-VolumesSnapshotsTestJSON-1033668188 None] Lock "cinder-fadd2841-9821-4f18-8137-5fa85cfb03fa-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:20:55 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:20:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Flow 'volume_create_manager' (f9fccece-c436-4e0e-b7b1-78636b6bdc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:20:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c882db7a-9918-4a3a-8924-fe206068779e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c882db7a-9918-4a3a-8924-fe206068779e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-810612646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55c71bfb-772f-4c94-8f6c-e742d72a6416,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='83329af2a75a40f7a262e5fd71ef5907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:20:55Z,use_quota=True,user_id='2012c81de3314985b7e7ec4897b9decf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac2eeea5-94a2-4d6e-8bf8-de8207c4fab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac2eeea5-94a2-4d6e-8bf8-de8207c4fab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a0d179-eebd-4988-9fb5-caa9ede12769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a0d179-eebd-4988-9fb5-caa9ede12769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55c71bfb-772f-4c94-8f6c-e742d72a6416', 'volume_name': 'volume-55c71bfb-772f-4c94-8f6c-e742d72a6416', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b249a5ed-6c49-4baa-a8b6-7aa5698fd7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b249a5ed-6c49-4baa-a8b6-7aa5698fd7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:20:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa74a7f9-0d5c-4795-a5c7-314ca8b745e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:20:55 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Volume 55c71bfb-772f-4c94-8f6c-e742d72a6416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55c71bfb-772f-4c94-8f6c-e742d72a6416', 'volume_size': 1} Sep 09 18:20:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:05 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=102,cinder:INSERT=30,cinder:UPDATE=130,cinder:DELETE=6 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:21:05 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=99,cinder:INSERT=33,cinder:UPDATE=113,cinder:DELETE=11 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:21:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-59f591ee-798a-4c03-bb6d-89b3b6c47b47 tempest-VolumesActionsTest-55346329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.507s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-59f591ee-798a-4c03-bb6d-89b3b6c47b47 tempest-VolumesActionsTest-55346329 None] Uploaded volume to glance image-id: a469e49d-c36d-4e52-94d8-b00992ae5581. {{(pid=87639) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 09 18:21:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3959a4ab-a67f-4b75-a7db-33fedffb0bb6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 25.603s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-3959a4ab-a67f-4b75-a7db-33fedffb0bb6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Creating offline snapshot db178504-f864-4aed-9a73-f0123e053546 of volume 45cf4b6f-a85b-4796-a0c4-853bc697cc3a {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:21:08 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-59f591ee-798a-4c03-bb6d-89b3b6c47b47 tempest-VolumesActionsTest-55346329 None] Copy volume to image completed successfully. Sep 09 18:21:08 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3189965-e4f5-4c35-b2dc-96055a8c3894]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3959a4ab-a67f-4b75-a7db-33fedffb0bb6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:08 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a Sep 09 18:21:08 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:09 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3959a4ab-a67f-4b75-a7db-33fedffb0bb6 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a" returned: 0 in 0.362s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3959a4ab-a67f-4b75-a7db-33fedffb0bb6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:09 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546 1G Sep 09 18:21:09 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:09 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3959a4ab-a67f-4b75-a7db-33fedffb0bb6 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546 1G" returned: 0 in 0.421s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3959a4ab-a67f-4b75-a7db-33fedffb0bb6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:09 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546 Sep 09 18:21:09 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:09 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3959a4ab-a67f-4b75-a7db-33fedffb0bb6 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546" returned: 0 in 0.289s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:09 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-3959a4ab-a67f-4b75-a7db-33fedffb0bb6 tempest-VolumesSnapshotListTestJSON-1265411180 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546 is being set with open permissions: ugo+rw Sep 09 18:21:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3959a4ab-a67f-4b75-a7db-33fedffb0bb6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:09 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546 Sep 09 18:21:09 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:10 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3959a4ab-a67f-4b75-a7db-33fedffb0bb6 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546" returned: 0 in 0.237s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3959a4ab-a67f-4b75-a7db-33fedffb0bb6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:10 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.info Sep 09 18:21:10 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:10 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3959a4ab-a67f-4b75-a7db-33fedffb0bb6 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.info" returned: 0 in 0.245s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:10 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-3959a4ab-a67f-4b75-a7db-33fedffb0bb6 tempest-VolumesSnapshotListTestJSON-1265411180 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.info is being set with open permissions: ugo+rw Sep 09 18:21:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3959a4ab-a67f-4b75-a7db-33fedffb0bb6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:10 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.info Sep 09 18:21:10 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:10 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3959a4ab-a67f-4b75-a7db-33fedffb0bb6 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.info" returned: 0 in 0.237s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3959a4ab-a67f-4b75-a7db-33fedffb0bb6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.884s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.991s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1467504909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0861bdbe-e294-4e14-a9b3-c24849190f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d8a2c248cc43d4a51705dbaa3f08c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:20:43Z,use_quota=True,user_id='a0feeb310e3947bfa19af7bbe411d183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:21:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Creating volume 0861bdbe-e294-4e14-a9b3-c24849190f60 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:21:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:21:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:21:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:21:10 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:21:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0861bdbe-e294-4e14-a9b3-c24849190f60 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:10 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0861bdbe-e294-4e14-a9b3-c24849190f60 1073741824 Sep 09 18:21:10 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:10 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-3959a4ab-a67f-4b75-a7db-33fedffb0bb6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Create snapshot completed successfully Sep 09 18:21:10 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0861bdbe-e294-4e14-a9b3-c24849190f60 1073741824" returned: 0 in 0.400s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0861bdbe-e294-4e14-a9b3-c24849190f60 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:11 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0861bdbe-e294-4e14-a9b3-c24849190f60 Sep 09 18:21:11 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:11 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0861bdbe-e294-4e14-a9b3-c24849190f60" returned: 0 in 0.239s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:21:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.946s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:20:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-810612646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55c71bfb-772f-4c94-8f6c-e742d72a6416,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='83329af2a75a40f7a262e5fd71ef5907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:20:55Z,use_quota=True,user_id='2012c81de3314985b7e7ec4897b9decf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:21:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Creating volume 55c71bfb-772f-4c94-8f6c-e742d72a6416 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:21:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:21:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:21:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:21:11 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:21:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55c71bfb-772f-4c94-8f6c-e742d72a6416 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b120a5-6443-47f8-b9cc-f5158f2b5fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0861bdbe-e294-4e14-a9b3-c24849190f60', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:11 devstack sudo[99071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55c71bfb-772f-4c94-8f6c-e742d72a6416 1073741824 Sep 09 18:21:11 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e1152b-f726-4bd4-bfe6-15aa33b4ed95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:11 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Volume volume-0861bdbe-e294-4e14-a9b3-c24849190f60 (0861bdbe-e294-4e14-a9b3-c24849190f60): created successfully Sep 09 18:21:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e1152b-f726-4bd4-bfe6-15aa33b4ed95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Flow 'volume_create_manager' (118e2978-aeff-43f6-bcad-7100f286d7b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:21:11 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-e6fbfebd-0f57-45c1-8e0e-c4e49ae00921 tempest-VolumesTransfersV357Test-1131186302 None] Created volume successfully. Sep 09 18:21:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b0ef7935-e454-491e-9ffa-e00d2e26e2f3 tempest-VolumesSnapshotListTestJSON-1265411180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:11 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55c71bfb-772f-4c94-8f6c-e742d72a6416 1073741824" returned: 0 in 0.473s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55c71bfb-772f-4c94-8f6c-e742d72a6416 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:11 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55c71bfb-772f-4c94-8f6c-e742d72a6416 Sep 09 18:21:11 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:11 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55c71bfb-772f-4c94-8f6c-e742d72a6416" returned: 0 in 0.251s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:21:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.324s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa74a7f9-0d5c-4795-a5c7-314ca8b745e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55c71bfb-772f-4c94-8f6c-e742d72a6416', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac831be4-166e-4533-b09d-7e603f8b4f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:12 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb18165-5d3e-48c8-b7c1-bad2deb454dd]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:12 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Volume volume-55c71bfb-772f-4c94-8f6c-e742d72a6416 (55c71bfb-772f-4c94-8f6c-e742d72a6416): created successfully Sep 09 18:21:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac831be4-166e-4533-b09d-7e603f8b4f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Flow 'volume_create_manager' (f9fccece-c436-4e0e-b7b1-78636b6bdc6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:21:12 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-d461ff13-3cd9-493c-b310-b22f128b04ee req-34be2e50-a365-4196-95ae-6cf08bf3cefe tempest-VolumesGetTestJSON-642040005 None] Created volume successfully. Sep 09 18:21:12 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 Sep 09 18:21:12 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:12 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-75ece3e4-ebc3-49aa-b95b-2ca67e0bdb4e tempest-VolumesTransfersV357Test-940847796 None] Transfer volume completed successfully. Sep 09 18:21:12 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95" returned: 0 in 0.377s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:12 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e08f69-38c3-4f84-ad66-2b5931b029e4]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:12 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 Sep 09 18:21:12 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:12 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95" returned: 0 in 0.415s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 /opt/stack/data/cinder/conversion/5440ff22-25fc-46df-b2f4-6ce5e052fc95.temp_image.32602340-3767-4414-84d3-d8e0674d8b139sldh0r1.img {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:12 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 /opt/stack/data/cinder/conversion/5440ff22-25fc-46df-b2f4-6ce5e052fc95.temp_image.32602340-3767-4414-84d3-d8e0674d8b139sldh0r1.img Sep 09 18:21:12 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d117043b-f3d8-44c1-aaaa-a56b60aaaf6f tempest-VolumesTransfersV357Test-188327483 None] Acquiring lock "cinder-0861bdbe-e294-4e14-a9b3-c24849190f60-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-f3e44843-1112-4796-837a-2a1df97af6fa req-81e4ef74-65b1-4b6e-8b16-1529129747c5 tempest-VolumesGetTestJSON-642040005 None] Acquiring lock "cinder-55c71bfb-772f-4c94-8f6c-e742d72a6416-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d117043b-f3d8-44c1-aaaa-a56b60aaaf6f tempest-VolumesTransfersV357Test-188327483 None] Lock "cinder-0861bdbe-e294-4e14-a9b3-c24849190f60-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-f3e44843-1112-4796-837a-2a1df97af6fa req-81e4ef74-65b1-4b6e-8b16-1529129747c5 tempest-VolumesGetTestJSON-642040005 None] Lock "cinder-55c71bfb-772f-4c94-8f6c-e742d72a6416-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:13 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d117043b-f3d8-44c1-aaaa-a56b60aaaf6f tempest-VolumesTransfersV357Test-188327483 None] Acquiring lock "cinder-quobyte-0861bdbe-e294-4e14-a9b3-c24849190f60" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:13 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d117043b-f3d8-44c1-aaaa-a56b60aaaf6f tempest-VolumesTransfersV357Test-188327483 None] Lock "cinder-quobyte-0861bdbe-e294-4e14-a9b3-c24849190f60" acquired by "delete_volume" :: waited 0.030s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:13 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-f3e44843-1112-4796-837a-2a1df97af6fa req-81e4ef74-65b1-4b6e-8b16-1529129747c5 tempest-VolumesGetTestJSON-642040005 None] Acquiring lock "cinder-quobyte-55c71bfb-772f-4c94-8f6c-e742d72a6416" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:13 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[095067a0-e2fa-431d-98e7-1dbe39f0c453]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d117043b-f3d8-44c1-aaaa-a56b60aaaf6f tempest-VolumesTransfersV357Test-188327483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0861bdbe-e294-4e14-a9b3-c24849190f60 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:13 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-f3e44843-1112-4796-837a-2a1df97af6fa req-81e4ef74-65b1-4b6e-8b16-1529129747c5 tempest-VolumesGetTestJSON-642040005 None] Lock "cinder-quobyte-55c71bfb-772f-4c94-8f6c-e742d72a6416" acquired by "delete_volume" :: waited 0.027s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:13 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[943def85-4283-4042-8530-098c5c5e625a]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-f3e44843-1112-4796-837a-2a1df97af6fa req-81e4ef74-65b1-4b6e-8b16-1529129747c5 tempest-VolumesGetTestJSON-642040005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55c71bfb-772f-4c94-8f6c-e742d72a6416 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:13 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0861bdbe-e294-4e14-a9b3-c24849190f60 Sep 09 18:21:13 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:13 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55c71bfb-772f-4c94-8f6c-e742d72a6416 Sep 09 18:21:13 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:13 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d117043b-f3d8-44c1-aaaa-a56b60aaaf6f tempest-VolumesTransfersV357Test-188327483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0861bdbe-e294-4e14-a9b3-c24849190f60" returned: 0 in 0.774s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d117043b-f3d8-44c1-aaaa-a56b60aaaf6f tempest-VolumesTransfersV357Test-188327483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0861bdbe-e294-4e14-a9b3-c24849190f60 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:13 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0861bdbe-e294-4e14-a9b3-c24849190f60 Sep 09 18:21:13 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:14 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-f3e44843-1112-4796-837a-2a1df97af6fa req-81e4ef74-65b1-4b6e-8b16-1529129747c5 tempest-VolumesGetTestJSON-642040005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55c71bfb-772f-4c94-8f6c-e742d72a6416" returned: 0 in 0.924s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-f3e44843-1112-4796-837a-2a1df97af6fa req-81e4ef74-65b1-4b6e-8b16-1529129747c5 tempest-VolumesGetTestJSON-642040005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55c71bfb-772f-4c94-8f6c-e742d72a6416 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:14 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55c71bfb-772f-4c94-8f6c-e742d72a6416 Sep 09 18:21:14 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:14 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d117043b-f3d8-44c1-aaaa-a56b60aaaf6f tempest-VolumesTransfersV357Test-188327483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0861bdbe-e294-4e14-a9b3-c24849190f60" returned: 0 in 0.539s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:14 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d117043b-f3d8-44c1-aaaa-a56b60aaaf6f tempest-VolumesTransfersV357Test-188327483 None] Lock "cinder-quobyte-0861bdbe-e294-4e14-a9b3-c24849190f60" released by "delete_volume" :: held 1.376s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:14 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-d117043b-f3d8-44c1-aaaa-a56b60aaaf6f tempest-VolumesTransfersV357Test-188327483 None] Created reservations ['a42b8c2f-24fd-4d15-bf3f-8b7e43ce1059', '1b043bb8-cdb6-4265-bec0-a302f0cca7f7', '361791d0-7e67-4754-bc55-550e5e43324c', '4d3b15af-c6c2-47bf-94fc-e3d8440c3e11'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:21:14 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d117043b-f3d8-44c1-aaaa-a56b60aaaf6f tempest-VolumesTransfersV357Test-188327483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d117043b-f3d8-44c1-aaaa-a56b60aaaf6f tempest-VolumesTransfersV357Test-188327483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d117043b-f3d8-44c1-aaaa-a56b60aaaf6f tempest-VolumesTransfersV357Test-188327483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:21:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d117043b-f3d8-44c1-aaaa-a56b60aaaf6f tempest-VolumesTransfersV357Test-188327483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:21:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d117043b-f3d8-44c1-aaaa-a56b60aaaf6f tempest-VolumesTransfersV357Test-188327483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d117043b-f3d8-44c1-aaaa-a56b60aaaf6f tempest-VolumesTransfersV357Test-188327483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-f3e44843-1112-4796-837a-2a1df97af6fa req-81e4ef74-65b1-4b6e-8b16-1529129747c5 tempest-VolumesGetTestJSON-642040005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55c71bfb-772f-4c94-8f6c-e742d72a6416" returned: 0 in 0.765s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:14 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:21:14 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:14 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-f3e44843-1112-4796-837a-2a1df97af6fa req-81e4ef74-65b1-4b6e-8b16-1529129747c5 tempest-VolumesGetTestJSON-642040005 None] Lock "cinder-quobyte-55c71bfb-772f-4c94-8f6c-e742d72a6416" released by "delete_volume" :: held 1.765s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:15 devstack cinder-volume[87639]: DEBUG cinder.quota [req-f3e44843-1112-4796-837a-2a1df97af6fa req-81e4ef74-65b1-4b6e-8b16-1529129747c5 tempest-VolumesGetTestJSON-642040005 None] Created reservations ['a27dda7f-95c6-4bb7-bda8-df2891da42ad', 'c8f88bf8-ebb9-4487-8c6c-51d89683c41b', '17035923-ad9a-4a36-8776-4db401d36e46', '2dc90c82-5a42-4b97-bab7-b8712e0ef4c4'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:21:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-f3e44843-1112-4796-837a-2a1df97af6fa req-81e4ef74-65b1-4b6e-8b16-1529129747c5 tempest-VolumesGetTestJSON-642040005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-f3e44843-1112-4796-837a-2a1df97af6fa req-81e4ef74-65b1-4b6e-8b16-1529129747c5 tempest-VolumesGetTestJSON-642040005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:15 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [req-f3e44843-1112-4796-837a-2a1df97af6fa req-81e4ef74-65b1-4b6e-8b16-1529129747c5 tempest-VolumesGetTestJSON-642040005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:21:15 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [req-f3e44843-1112-4796-837a-2a1df97af6fa req-81e4ef74-65b1-4b6e-8b16-1529129747c5 tempest-VolumesGetTestJSON-642040005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:21:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-f3e44843-1112-4796-837a-2a1df97af6fa req-81e4ef74-65b1-4b6e-8b16-1529129747c5 tempest-VolumesGetTestJSON-642040005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-f3e44843-1112-4796-837a-2a1df97af6fa req-81e4ef74-65b1-4b6e-8b16-1529129747c5 tempest-VolumesGetTestJSON-642040005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:15 devstack sudo[99121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:21:15 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:15 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d117043b-f3d8-44c1-aaaa-a56b60aaaf6f tempest-VolumesTransfersV357Test-188327483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.895s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:15 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-d117043b-f3d8-44c1-aaaa-a56b60aaaf6f tempest-VolumesTransfersV357Test-188327483 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:21:15 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d117043b-f3d8-44c1-aaaa-a56b60aaaf6f tempest-VolumesTransfersV357Test-188327483 None] Deleted volume successfully. Sep 09 18:21:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d117043b-f3d8-44c1-aaaa-a56b60aaaf6f tempest-VolumesTransfersV357Test-188327483 None] Lock "cinder-0861bdbe-e294-4e14-a9b3-c24849190f60-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:15 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-f3e44843-1112-4796-837a-2a1df97af6fa req-81e4ef74-65b1-4b6e-8b16-1529129747c5 tempest-VolumesGetTestJSON-642040005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.695s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:15 devstack cinder-volume[87639]: DEBUG cinder.manager [req-f3e44843-1112-4796-837a-2a1df97af6fa req-81e4ef74-65b1-4b6e-8b16-1529129747c5 tempest-VolumesGetTestJSON-642040005 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:21:15 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-f3e44843-1112-4796-837a-2a1df97af6fa req-81e4ef74-65b1-4b6e-8b16-1529129747c5 tempest-VolumesGetTestJSON-642040005 None] Deleted volume successfully. Sep 09 18:21:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-f3e44843-1112-4796-837a-2a1df97af6fa req-81e4ef74-65b1-4b6e-8b16-1529129747c5 tempest-VolumesGetTestJSON-642040005 None] Lock "cinder-55c71bfb-772f-4c94-8f6c-e742d72a6416-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:16 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:21:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Flow 'volume_create_manager' (2d7bbc20-cead-4b81-aaff-c3f36331bf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:21:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67dbe729-b7c3-4897-9dc1-c11495b875e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67dbe729-b7c3-4897-9dc1-c11495b875e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1630793346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0222fd3-44b1-4fac-9261-5424d8fa3a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d8a2c248cc43d4a51705dbaa3f08c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:21:16Z,use_quota=True,user_id='a0feeb310e3947bfa19af7bbe411d183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2aa9f73-73c3-4698-a029-5be951ca8617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2aa9f73-73c3-4698-a029-5be951ca8617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46cf9872-dab4-429b-8ba8-5b67021a0035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46cf9872-dab4-429b-8ba8-5b67021a0035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0222fd3-44b1-4fac-9261-5424d8fa3a5a', 'volume_name': 'volume-f0222fd3-44b1-4fac-9261-5424d8fa3a5a', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a392fa0-355d-4d67-b2fe-8076afa68e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a392fa0-355d-4d67-b2fe-8076afa68e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2139b1ef-3e95-486e-bfcc-5212cdaee1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:16 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Volume f0222fd3-44b1-4fac-9261-5424d8fa3a5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0222fd3-44b1-4fac-9261-5424d8fa3a5a', 'volume_size': 1} Sep 09 18:21:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:17 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 /opt/stack/data/cinder/conversion/5440ff22-25fc-46df-b2f4-6ce5e052fc95.temp_image.32602340-3767-4414-84d3-d8e0674d8b139sldh0r1.img" returned: 0 in 5.149s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:18 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ace80d6-2e0f-4fd4-a970-4ed4500e48ba]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:18 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 Sep 09 18:21:18 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:18 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95" returned: 0 in 0.563s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:18 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] Image conversion details: src /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/conversion/5440ff22-25fc-46df-b2f4-6ce5e052fc95.temp_image.32602340-3767-4414-84d3-d8e0674d8b139sldh0r1.img {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:21:18 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] Converted 1024.00 MB image at 198.83 MB/s Sep 09 18:21:18 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] 32602340-3767-4414-84d3-d8e0674d8b13 was raw, converting to qcow2 {{(pid=87639) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 09 18:21:18 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca6596f-d1ec-4164-93c2-c74675383ef4]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5440ff22-25fc-46df-b2f4-6ce5e052fc95.temp_image.32602340-3767-4414-84d3-d8e0674d8b139sldh0r1.img {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:18 devstack sudo[99131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5440ff22-25fc-46df-b2f4-6ce5e052fc95.temp_image.32602340-3767-4414-84d3-d8e0674d8b139sldh0r1.img Sep 09 18:21:18 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:18 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5440ff22-25fc-46df-b2f4-6ce5e052fc95.temp_image.32602340-3767-4414-84d3-d8e0674d8b139sldh0r1.img" returned: 0 in 0.343s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5440ff22-25fc-46df-b2f4-6ce5e052fc95.temp_image.32602340-3767-4414-84d3-d8e0674d8b139sldh0r1.img {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:19 devstack sudo[99135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5440ff22-25fc-46df-b2f4-6ce5e052fc95.temp_image.32602340-3767-4414-84d3-d8e0674d8b139sldh0r1.img Sep 09 18:21:19 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:19 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5440ff22-25fc-46df-b2f4-6ce5e052fc95.temp_image.32602340-3767-4414-84d3-d8e0674d8b139sldh0r1.img" returned: 1 in 0.337s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5440ff22-25fc-46df-b2f4-6ce5e052fc95.temp_image.32602340-3767-4414-84d3-d8e0674d8b139sldh0r1.img' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:21:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5440ff22-25fc-46df-b2f4-6ce5e052fc95.temp_image.32602340-3767-4414-84d3-d8e0674d8b139sldh0r1.img /opt/stack/data/cinder/conversion/vol_upload_ik8vra4g {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:19 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5440ff22-25fc-46df-b2f4-6ce5e052fc95.temp_image.32602340-3767-4414-84d3-d8e0674d8b139sldh0r1.img /opt/stack/data/cinder/conversion/vol_upload_ik8vra4g Sep 09 18:21:19 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:19 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5440ff22-25fc-46df-b2f4-6ce5e052fc95.temp_image.32602340-3767-4414-84d3-d8e0674d8b139sldh0r1.img /opt/stack/data/cinder/conversion/vol_upload_ik8vra4g" returned: 0 in 0.275s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:19 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] Image conversion details: src /opt/stack/data/cinder/conversion/5440ff22-25fc-46df-b2f4-6ce5e052fc95.temp_image.32602340-3767-4414-84d3-d8e0674d8b139sldh0r1.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ik8vra4g {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:21:19 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 09 18:21:19 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6647e12-5df8-440b-a9a4-d11e027ffdf2]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ik8vra4g {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:19 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ik8vra4g Sep 09 18:21:19 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:19 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ik8vra4g" returned: 0 in 0.369s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.643s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] Uploaded volume to glance image-id: 32602340-3767-4414-84d3-d8e0674d8b13. {{(pid=87639) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 09 18:21:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b0ef7935-e454-491e-9ffa-e00d2e26e2f3 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.218s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:21 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-49f53be2-2566-4188-8523-24b1595f66c9 tempest-GroupSnapshotsV319Test-1791322880 None] Group tempest-GroupSnapshotsV319Test-Group-166518139: creating Sep 09 18:21:21 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-139a56d2-cc06-443f-b5c1-bc103ef7c2ae tempest-VolumesActionsTest-55346329 None] Copy volume to image completed successfully. Sep 09 18:21:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b0ef7935-e454-491e-9ffa-e00d2e26e2f3 tempest-VolumesSnapshotListTestJSON-1265411180 None] Creating offline snapshot 54ba06e6-b0bd-44b0-b5a5-acfd60274fec of volume 45cf4b6f-a85b-4796-a0c4-853bc697cc3a {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:21:21 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f539a4d9-64e8-492c-af2a-a35d89ba5410]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b0ef7935-e454-491e-9ffa-e00d2e26e2f3 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:21 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-49f53be2-2566-4188-8523-24b1595f66c9 tempest-GroupSnapshotsV319Test-1791322880 None] Group tempest-GroupSnapshotsV319Test-Group-166518139: created successfully Sep 09 18:21:21 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-49f53be2-2566-4188-8523-24b1595f66c9 tempest-GroupSnapshotsV319Test-1791322880 None] Create group completed successfully. Sep 09 18:21:21 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546 Sep 09 18:21:21 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:22 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b0ef7935-e454-491e-9ffa-e00d2e26e2f3 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546" returned: 0 in 0.369s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b0ef7935-e454-491e-9ffa-e00d2e26e2f3 tempest-VolumesSnapshotListTestJSON-1265411180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:21:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b0ef7935-e454-491e-9ffa-e00d2e26e2f3 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:22 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec 1G Sep 09 18:21:22 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:22 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b0ef7935-e454-491e-9ffa-e00d2e26e2f3 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec 1G" returned: 0 in 0.449s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b0ef7935-e454-491e-9ffa-e00d2e26e2f3 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:22 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec Sep 09 18:21:22 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:22 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b0ef7935-e454-491e-9ffa-e00d2e26e2f3 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec" returned: 0 in 0.302s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:22 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-b0ef7935-e454-491e-9ffa-e00d2e26e2f3 tempest-VolumesSnapshotListTestJSON-1265411180 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec is being set with open permissions: ugo+rw Sep 09 18:21:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b0ef7935-e454-491e-9ffa-e00d2e26e2f3 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:22 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec Sep 09 18:21:22 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a59a937e-fd3e-4ee4-acee-da027b4e68ae tempest-VolumesActionsTest-55346329 None] Acquiring lock "cinder-5440ff22-25fc-46df-b2f4-6ce5e052fc95-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a59a937e-fd3e-4ee4-acee-da027b4e68ae tempest-VolumesActionsTest-55346329 None] Lock "cinder-5440ff22-25fc-46df-b2f4-6ce5e052fc95-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a59a937e-fd3e-4ee4-acee-da027b4e68ae tempest-VolumesActionsTest-55346329 None] Acquiring lock "cinder-quobyte-5440ff22-25fc-46df-b2f4-6ce5e052fc95" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:23 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a59a937e-fd3e-4ee4-acee-da027b4e68ae tempest-VolumesActionsTest-55346329 None] Lock "cinder-quobyte-5440ff22-25fc-46df-b2f4-6ce5e052fc95" acquired by "delete_volume" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b0ef7935-e454-491e-9ffa-e00d2e26e2f3 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec" returned: 0 in 0.320s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b0ef7935-e454-491e-9ffa-e00d2e26e2f3 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.550s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[47380285-aa0e-45a1-99e6-82e6a086eb8a]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.459s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1630793346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0222fd3-44b1-4fac-9261-5424d8fa3a5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83d8a2c248cc43d4a51705dbaa3f08c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:21:16Z,use_quota=True,user_id='a0feeb310e3947bfa19af7bbe411d183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Creating volume f0222fd3-44b1-4fac-9261-5424d8fa3a5a {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:21:23 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f0222fd3-44b1-4fac-9261-5424d8fa3a5a 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a59a937e-fd3e-4ee4-acee-da027b4e68ae tempest-VolumesActionsTest-55346329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:23 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f0222fd3-44b1-4fac-9261-5424d8fa3a5a 1073741824 Sep 09 18:21:23 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:23 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-b0ef7935-e454-491e-9ffa-e00d2e26e2f3 tempest-VolumesSnapshotListTestJSON-1265411180 None] Create snapshot completed successfully Sep 09 18:21:23 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 Sep 09 18:21:23 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Flow 'volume_create_manager' (dbb6b487-994f-4028-9291-59f305b44520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904d8762-aba7-4f2b-b934-5c8420301bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904d8762-aba7-4f2b-b934-5c8420301bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-323261118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef148efc-a485-4d78-8d65-ae8e7065c37a,host='devstack@QuobyteHD#QuobyteHD',id=189d3f99-d870-4d44-8ce2-d440bec8c674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4136bbbbbff043d180d8bd51361c6a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:21:23Z,use_quota=True,user_id='8988553660f14c31a140257377dca0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8845d1e-62c5-4aa8-ab61-d4e85a99d9ea),volume_type_id=f8845d1e-62c5-4aa8-ab61-d4e85a99d9ea)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d31806-aa32-40c7-8a93-54744c72f2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d31806-aa32-40c7-8a93-54744c72f2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc570345-6ced-4af7-94d1-d23ca300233b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc570345-6ced-4af7-94d1-d23ca300233b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '189d3f99-d870-4d44-8ce2-d440bec8c674', 'volume_name': 'volume-189d3f99-d870-4d44-8ce2-d440bec8c674', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18fceaaf-ca4c-49a7-be18-4a81376c3cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18fceaaf-ca4c-49a7-be18-4a81376c3cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933d3520-4f04-4966-85f9-c0e05e73af03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:23 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Volume 189d3f99-d870-4d44-8ce2-d440bec8c674: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-189d3f99-d870-4d44-8ce2-d440bec8c674', 'volume_size': 1} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:23 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a59a937e-fd3e-4ee4-acee-da027b4e68ae tempest-VolumesActionsTest-55346329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95" returned: 0 in 0.463s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a59a937e-fd3e-4ee4-acee-da027b4e68ae tempest-VolumesActionsTest-55346329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:23 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f0222fd3-44b1-4fac-9261-5424d8fa3a5a 1073741824" returned: 0 in 0.488s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:23 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95 Sep 09 18:21:23 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f0222fd3-44b1-4fac-9261-5424d8fa3a5a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:23 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f0222fd3-44b1-4fac-9261-5424d8fa3a5a Sep 09 18:21:23 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:23 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a59a937e-fd3e-4ee4-acee-da027b4e68ae tempest-VolumesActionsTest-55346329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-5440ff22-25fc-46df-b2f4-6ce5e052fc95" returned: 0 in 0.272s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a59a937e-fd3e-4ee4-acee-da027b4e68ae tempest-VolumesActionsTest-55346329 None] Lock "cinder-quobyte-5440ff22-25fc-46df-b2f4-6ce5e052fc95" released by "delete_volume" :: held 0.827s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:23 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f0222fd3-44b1-4fac-9261-5424d8fa3a5a" returned: 0 in 0.245s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:21:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.480s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ef148efc-a485-4d78-8d65-ae8e7065c37a,created_at=2026-09-09T16:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-323261118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef148efc-a485-4d78-8d65-ae8e7065c37a,host='devstack@QuobyteHD#QuobyteHD',id=189d3f99-d870-4d44-8ce2-d440bec8c674,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4136bbbbbff043d180d8bd51361c6a1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:21:23Z,use_quota=True,user_id='8988553660f14c31a140257377dca0fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8845d1e-62c5-4aa8-ab61-d4e85a99d9ea),volume_type_id=f8845d1e-62c5-4aa8-ab61-d4e85a99d9ea)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Creating volume 189d3f99-d870-4d44-8ce2-d440bec8c674 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:21:24 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:24 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674 1073741824 Sep 09 18:21:24 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2139b1ef-3e95-486e-bfcc-5212cdaee1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0222fd3-44b1-4fac-9261-5424d8fa3a5a', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eea1139-11f7-467c-8edc-91d6fb0226bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:24 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Volume volume-f0222fd3-44b1-4fac-9261-5424d8fa3a5a (f0222fd3-44b1-4fac-9261-5424d8fa3a5a): created successfully Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eea1139-11f7-467c-8edc-91d6fb0226bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Flow 'volume_create_manager' (2d7bbc20-cead-4b81-aaff-c3f36331bf47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:21:24 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-54a303bc-738e-40f5-af2c-60d7cd4a2ec5 tempest-VolumesTransfersV357Test-1131186302 None] Created volume successfully. Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-a59a937e-fd3e-4ee4-acee-da027b4e68ae tempest-VolumesActionsTest-55346329 None] Created reservations ['1740da78-7399-4ebf-b6d8-bbbb36dff067', '14eb43c7-bec7-48da-a053-5da3bffff519', 'e279d2fb-f9fe-4f3a-a7f9-7723d1dbdaba', '6f21dd48-9984-44b3-bce0-aa7fab62e199'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a59a937e-fd3e-4ee4-acee-da027b4e68ae tempest-VolumesActionsTest-55346329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a59a937e-fd3e-4ee4-acee-da027b4e68ae tempest-VolumesActionsTest-55346329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a59a937e-fd3e-4ee4-acee-da027b4e68ae tempest-VolumesActionsTest-55346329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a59a937e-fd3e-4ee4-acee-da027b4e68ae tempest-VolumesActionsTest-55346329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a59a937e-fd3e-4ee4-acee-da027b4e68ae tempest-VolumesActionsTest-55346329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a59a937e-fd3e-4ee4-acee-da027b4e68ae tempest-VolumesActionsTest-55346329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:24 devstack sudo[99196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:21:24 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-aa4f391a-ec7f-45c9-920c-c9418c82a729 tempest-VolumesSnapshotListTestJSON-1265411180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:24 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674 1073741824" returned: 0 in 0.534s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:24 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a59a937e-fd3e-4ee4-acee-da027b4e68ae tempest-VolumesActionsTest-55346329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.352s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-a59a937e-fd3e-4ee4-acee-da027b4e68ae tempest-VolumesActionsTest-55346329 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:21:24 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-a59a937e-fd3e-4ee4-acee-da027b4e68ae tempest-VolumesActionsTest-55346329 None] Deleted volume successfully. Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a59a937e-fd3e-4ee4-acee-da027b4e68ae tempest-VolumesActionsTest-55346329 None] Lock "cinder-5440ff22-25fc-46df-b2f4-6ce5e052fc95-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:24 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674 Sep 09 18:21:24 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:24 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674" returned: 0 in 0.247s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-aa4f391a-ec7f-45c9-920c-c9418c82a729 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.405s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933d3520-4f04-4966-85f9-c0e05e73af03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-189d3f99-d870-4d44-8ce2-d440bec8c674', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0125f1c9-58b5-40b1-bf1e-d0939d4933d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-aa4f391a-ec7f-45c9-920c-c9418c82a729 tempest-VolumesSnapshotListTestJSON-1265411180 None] Creating offline snapshot d35a11d8-cfc3-4c82-a606-c37a2f91a7d2 of volume 45cf4b6f-a85b-4796-a0c4-853bc697cc3a {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[932a7c17-e6c7-476c-8ecf-5ebea0e1a905]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:24 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Volume volume-189d3f99-d870-4d44-8ce2-d440bec8c674 (189d3f99-d870-4d44-8ce2-d440bec8c674): created successfully Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0125f1c9-58b5-40b1-bf1e-d0939d4933d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Flow 'volume_create_manager' (dbb6b487-994f-4028-9291-59f305b44520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:21:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa4f391a-ec7f-45c9-920c-c9418c82a729 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:24 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-fc3f5ef9-3e31-4820-ad10-5f18b6e75150 tempest-GroupSnapshotsV319Test-1791322880 None] Created volume successfully. Sep 09 18:21:25 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec Sep 09 18:21:25 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:25 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa4f391a-ec7f-45c9-920c-c9418c82a729 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec" returned: 0 in 0.483s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:25 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-aa4f391a-ec7f-45c9-920c-c9418c82a729 tempest-VolumesSnapshotListTestJSON-1265411180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:21:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa4f391a-ec7f-45c9-920c-c9418c82a729 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.d35a11d8-cfc3-4c82-a606-c37a2f91a7d2 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:25 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.d35a11d8-cfc3-4c82-a606-c37a2f91a7d2 1G Sep 09 18:21:25 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:25 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fd61ed9b-f4aa-4ef2-9ded-79f710c4c421 tempest-VolumesTransfersV357Test-188327483 None] Acquiring lock "cinder-f0222fd3-44b1-4fac-9261-5424d8fa3a5a-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:25 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fd61ed9b-f4aa-4ef2-9ded-79f710c4c421 tempest-VolumesTransfersV357Test-188327483 None] Lock "cinder-f0222fd3-44b1-4fac-9261-5424d8fa3a5a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:25 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fd61ed9b-f4aa-4ef2-9ded-79f710c4c421 tempest-VolumesTransfersV357Test-188327483 None] Acquiring lock "cinder-quobyte-f0222fd3-44b1-4fac-9261-5424d8fa3a5a" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:25 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fd61ed9b-f4aa-4ef2-9ded-79f710c4c421 tempest-VolumesTransfersV357Test-188327483 None] Lock "cinder-quobyte-f0222fd3-44b1-4fac-9261-5424d8fa3a5a" acquired by "delete_volume" :: waited 0.020s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:25 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07162ad-5863-4477-8a33-e85730f2e967]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fd61ed9b-f4aa-4ef2-9ded-79f710c4c421 tempest-VolumesTransfersV357Test-188327483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f0222fd3-44b1-4fac-9261-5424d8fa3a5a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:25 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f0222fd3-44b1-4fac-9261-5424d8fa3a5a Sep 09 18:21:25 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:26 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa4f391a-ec7f-45c9-920c-c9418c82a729 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.d35a11d8-cfc3-4c82-a606-c37a2f91a7d2 1G" returned: 0 in 0.603s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa4f391a-ec7f-45c9-920c-c9418c82a729 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.d35a11d8-cfc3-4c82-a606-c37a2f91a7d2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:26 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.d35a11d8-cfc3-4c82-a606-c37a2f91a7d2 Sep 09 18:21:26 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:26 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-9513bd19-a713-4cb1-b5cb-409065adb8b6 tempest-GroupSnapshotsV319Test-1791322880 None] GroupSnapshot e7829e55-495c-4b8b-8c50-c884acd233b3: creating. Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9513bd19-a713-4cb1-b5cb-409065adb8b6 tempest-GroupSnapshotsV319Test-1791322880 None] Group snapshot e7829e55-495c-4b8b-8c50-c884acd233b3: creating. {{(pid=87639) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9513bd19-a713-4cb1-b5cb-409065adb8b6 tempest-GroupSnapshotsV319Test-1791322880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:26 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fd61ed9b-f4aa-4ef2-9ded-79f710c4c421 tempest-VolumesTransfersV357Test-188327483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f0222fd3-44b1-4fac-9261-5424d8fa3a5a" returned: 0 in 0.546s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fd61ed9b-f4aa-4ef2-9ded-79f710c4c421 tempest-VolumesTransfersV357Test-188327483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f0222fd3-44b1-4fac-9261-5424d8fa3a5a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:26 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f0222fd3-44b1-4fac-9261-5424d8fa3a5a Sep 09 18:21:26 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:26 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa4f391a-ec7f-45c9-920c-c9418c82a729 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.d35a11d8-cfc3-4c82-a606-c37a2f91a7d2" returned: 0 in 0.394s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:26 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-aa4f391a-ec7f-45c9-920c-c9418c82a729 tempest-VolumesSnapshotListTestJSON-1265411180 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.d35a11d8-cfc3-4c82-a606-c37a2f91a7d2 is being set with open permissions: ugo+rw Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa4f391a-ec7f-45c9-920c-c9418c82a729 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.d35a11d8-cfc3-4c82-a606-c37a2f91a7d2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:26 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fd61ed9b-f4aa-4ef2-9ded-79f710c4c421 tempest-VolumesTransfersV357Test-188327483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f0222fd3-44b1-4fac-9261-5424d8fa3a5a" returned: 0 in 0.265s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:26 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.d35a11d8-cfc3-4c82-a606-c37a2f91a7d2 Sep 09 18:21:26 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fd61ed9b-f4aa-4ef2-9ded-79f710c4c421 tempest-VolumesTransfersV357Test-188327483 None] Lock "cinder-quobyte-f0222fd3-44b1-4fac-9261-5424d8fa3a5a" released by "delete_volume" :: held 0.876s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-fd61ed9b-f4aa-4ef2-9ded-79f710c4c421 tempest-VolumesTransfersV357Test-188327483 None] Created reservations ['198ab456-4185-4653-81d5-bcce4ca67036', '0f11fd72-5816-4168-bf36-fb0cb2731869', 'f49749ef-145f-47da-8bd3-82b671aaaf21', '43a0d398-32f4-4bb2-8b6a-2d56e6c89172'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fd61ed9b-f4aa-4ef2-9ded-79f710c4c421 tempest-VolumesTransfersV357Test-188327483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fd61ed9b-f4aa-4ef2-9ded-79f710c4c421 tempest-VolumesTransfersV357Test-188327483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fd61ed9b-f4aa-4ef2-9ded-79f710c4c421 tempest-VolumesTransfersV357Test-188327483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fd61ed9b-f4aa-4ef2-9ded-79f710c4c421 tempest-VolumesTransfersV357Test-188327483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fd61ed9b-f4aa-4ef2-9ded-79f710c4c421 tempest-VolumesTransfersV357Test-188327483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fd61ed9b-f4aa-4ef2-9ded-79f710c4c421 tempest-VolumesTransfersV357Test-188327483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:26 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:21:26 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:26 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa4f391a-ec7f-45c9-920c-c9418c82a729 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.d35a11d8-cfc3-4c82-a606-c37a2f91a7d2" returned: 0 in 0.286s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-aa4f391a-ec7f-45c9-920c-c9418c82a729 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.906s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9513bd19-a713-4cb1-b5cb-409065adb8b6 tempest-GroupSnapshotsV319Test-1791322880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.619s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-9513bd19-a713-4cb1-b5cb-409065adb8b6 tempest-GroupSnapshotsV319Test-1791322880 None] Creating offline snapshot dc7b3ea3-643f-4199-8c96-11dc72e3ea74 of volume 189d3f99-d870-4d44-8ce2-d440bec8c674 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:21:26 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-aa4f391a-ec7f-45c9-920c-c9418c82a729 tempest-VolumesSnapshotListTestJSON-1265411180 None] Create snapshot completed successfully Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6361c76c-e73a-4b4d-951a-33265a8d154b]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9513bd19-a713-4cb1-b5cb-409065adb8b6 tempest-GroupSnapshotsV319Test-1791322880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:26 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674 Sep 09 18:21:26 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:26 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fd61ed9b-f4aa-4ef2-9ded-79f710c4c421 tempest-VolumesTransfersV357Test-188327483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.336s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:26 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-fd61ed9b-f4aa-4ef2-9ded-79f710c4c421 tempest-VolumesTransfersV357Test-188327483 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:21:26 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-fd61ed9b-f4aa-4ef2-9ded-79f710c4c421 tempest-VolumesTransfersV357Test-188327483 None] Deleted volume successfully. Sep 09 18:21:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fd61ed9b-f4aa-4ef2-9ded-79f710c4c421 tempest-VolumesTransfersV357Test-188327483 None] Lock "cinder-f0222fd3-44b1-4fac-9261-5424d8fa3a5a-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:27 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9513bd19-a713-4cb1-b5cb-409065adb8b6 tempest-GroupSnapshotsV319Test-1791322880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674" returned: 0 in 0.486s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9513bd19-a713-4cb1-b5cb-409065adb8b6 tempest-GroupSnapshotsV319Test-1791322880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.dc7b3ea3-643f-4199-8c96-11dc72e3ea74 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:27 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.dc7b3ea3-643f-4199-8c96-11dc72e3ea74 1G Sep 09 18:21:27 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:27 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9513bd19-a713-4cb1-b5cb-409065adb8b6 tempest-GroupSnapshotsV319Test-1791322880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.dc7b3ea3-643f-4199-8c96-11dc72e3ea74 1G" returned: 0 in 0.458s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9513bd19-a713-4cb1-b5cb-409065adb8b6 tempest-GroupSnapshotsV319Test-1791322880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-189d3f99-d870-4d44-8ce2-d440bec8c674 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.dc7b3ea3-643f-4199-8c96-11dc72e3ea74 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:27 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-189d3f99-d870-4d44-8ce2-d440bec8c674 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.dc7b3ea3-643f-4199-8c96-11dc72e3ea74 Sep 09 18:21:27 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:28 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9513bd19-a713-4cb1-b5cb-409065adb8b6 tempest-GroupSnapshotsV319Test-1791322880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-189d3f99-d870-4d44-8ce2-d440bec8c674 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.dc7b3ea3-643f-4199-8c96-11dc72e3ea74" returned: 0 in 0.375s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:28 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-9513bd19-a713-4cb1-b5cb-409065adb8b6 tempest-GroupSnapshotsV319Test-1791322880 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.dc7b3ea3-643f-4199-8c96-11dc72e3ea74 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 18:21:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9513bd19-a713-4cb1-b5cb-409065adb8b6 tempest-GroupSnapshotsV319Test-1791322880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.dc7b3ea3-643f-4199-8c96-11dc72e3ea74 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:28 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.dc7b3ea3-643f-4199-8c96-11dc72e3ea74 Sep 09 18:21:28 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:28 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9513bd19-a713-4cb1-b5cb-409065adb8b6 tempest-GroupSnapshotsV319Test-1791322880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.dc7b3ea3-643f-4199-8c96-11dc72e3ea74" returned: 0 in 0.413s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9513bd19-a713-4cb1-b5cb-409065adb8b6 tempest-GroupSnapshotsV319Test-1791322880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:28 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.info Sep 09 18:21:28 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:28 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9513bd19-a713-4cb1-b5cb-409065adb8b6 tempest-GroupSnapshotsV319Test-1791322880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.info" returned: 0 in 0.336s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:28 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-9513bd19-a713-4cb1-b5cb-409065adb8b6 tempest-GroupSnapshotsV319Test-1791322880 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 18:21:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9513bd19-a713-4cb1-b5cb-409065adb8b6 tempest-GroupSnapshotsV319Test-1791322880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:28 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.info Sep 09 18:21:28 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] Acquiring lock "cinder-d35a11d8-cfc3-4c82-a606-c37a2f91a7d2-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "cinder-d35a11d8-cfc3-4c82-a606-c37a2f91a7d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] Acquiring lock "cinder-quobyte-45cf4b6f-a85b-4796-a0c4-853bc697cc3a" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "cinder-quobyte-45cf4b6f-a85b-4796-a0c4-853bc697cc3a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] Acquiring lock "cinder-quobyte-d35a11d8-cfc3-4c82-a606-c37a2f91a7d2" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "cinder-quobyte-d35a11d8-cfc3-4c82-a606-c37a2f91a7d2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] Deleting offline snapshot d35a11d8-cfc3-4c82-a606-c37a2f91a7d2 of volume 45cf4b6f-a85b-4796-a0c4-853bc697cc3a {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:21:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] snapshot_file for this snap is: volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.d35a11d8-cfc3-4c82-a606-c37a2f91a7d2 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:21:29 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea19453-2c61-4dae-bb5b-855cb4acef92]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.d35a11d8-cfc3-4c82-a606-c37a2f91a7d2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:29 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9513bd19-a713-4cb1-b5cb-409065adb8b6 tempest-GroupSnapshotsV319Test-1791322880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.info" returned: 0 in 0.318s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9513bd19-a713-4cb1-b5cb-409065adb8b6 tempest-GroupSnapshotsV319Test-1791322880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.533s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:29 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-9513bd19-a713-4cb1-b5cb-409065adb8b6 tempest-GroupSnapshotsV319Test-1791322880 None] group_snapshot e7829e55-495c-4b8b-8c50-c884acd233b3: created successfully Sep 09 18:21:29 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.d35a11d8-cfc3-4c82-a606-c37a2f91a7d2 Sep 09 18:21:29 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:29 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.d35a11d8-cfc3-4c82-a606-c37a2f91a7d2" returned: 0 in 0.551s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:21:29 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[724bf9f4-4c1b-498a-a204-1b1ba1975a3e]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:29 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec Sep 09 18:21:29 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:30 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec" returned: 0 in 0.421s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:30 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:21:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.d35a11d8-cfc3-4c82-a606-c37a2f91a7d2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:30 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.d35a11d8-cfc3-4c82-a606-c37a2f91a7d2 Sep 09 18:21:30 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:30 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.d35a11d8-cfc3-4c82-a606-c37a2f91a7d2" returned: 0 in 0.567s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.d35a11d8-cfc3-4c82-a606-c37a2f91a7d2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:30 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.d35a11d8-cfc3-4c82-a606-c37a2f91a7d2 Sep 09 18:21:30 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:30 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] group_snapshot e7829e55-495c-4b8b-8c50-c884acd233b3: deleting Sep 09 18:21:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] group_snapshot e7829e55-495c-4b8b-8c50-c884acd233b3: deleting {{(pid=87639) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 09 18:21:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] Acquiring lock "cinder-quobyte-189d3f99-d870-4d44-8ce2-d440bec8c674" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] Lock "cinder-quobyte-189d3f99-d870-4d44-8ce2-d440bec8c674" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] Acquiring lock "cinder-quobyte-dc7b3ea3-643f-4199-8c96-11dc72e3ea74" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:31 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] Lock "cinder-quobyte-dc7b3ea3-643f-4199-8c96-11dc72e3ea74" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] Deleting offline snapshot dc7b3ea3-643f-4199-8c96-11dc72e3ea74 of volume 189d3f99-d870-4d44-8ce2-d440bec8c674 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:21:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] snapshot_file for this snap is: volume-189d3f99-d870-4d44-8ce2-d440bec8c674.dc7b3ea3-643f-4199-8c96-11dc72e3ea74 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:21:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.d35a11d8-cfc3-4c82-a606-c37a2f91a7d2" returned: 0 in 0.436s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:31 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[98535824-7342-4fbe-b582-55f73e0c4200]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.dc7b3ea3-643f-4199-8c96-11dc72e3ea74 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "cinder-quobyte-d35a11d8-cfc3-4c82-a606-c37a2f91a7d2" released by "_delete_snapshot" :: held 2.122s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "cinder-quobyte-45cf4b6f-a85b-4796-a0c4-853bc697cc3a" released by "delete_snapshot" :: held 2.160s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:31 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] Created reservations ['2a748274-cb5f-4c04-8067-c11bc80711ee', 'e784a4c9-bea9-4618-ab75-132227a15c6d', '30bbd6aa-a270-470a-b6a4-cc3f87d5a680', '73351956-a301-4903-a7d8-37ebd31aeea5'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:21:31 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.dc7b3ea3-643f-4199-8c96-11dc72e3ea74 Sep 09 18:21:31 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:31 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] Delete snapshot completed successfully. Sep 09 18:21:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-066a1c24-d9d0-4736-beb2-ce6f7c617a90 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "cinder-d35a11d8-cfc3-4c82-a606-c37a2f91a7d2-delete_snapshot" released by "delete_snapshot" :: held 2.415s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:31 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.dc7b3ea3-643f-4199-8c96-11dc72e3ea74" returned: 0 in 0.548s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-189d3f99-d870-4d44-8ce2-d440bec8c674(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:21:31 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a08ffdf-9810-4bde-b337-78fd6b5b374a]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:31 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674 Sep 09 18:21:31 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:32 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674" returned: 0 in 0.440s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.dc7b3ea3-643f-4199-8c96-11dc72e3ea74 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:32 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.dc7b3ea3-643f-4199-8c96-11dc72e3ea74 Sep 09 18:21:32 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] Acquiring lock "cinder-54ba06e6-b0bd-44b0-b5a5-acfd60274fec-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "cinder-54ba06e6-b0bd-44b0-b5a5-acfd60274fec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] Acquiring lock "cinder-quobyte-45cf4b6f-a85b-4796-a0c4-853bc697cc3a" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "cinder-quobyte-45cf4b6f-a85b-4796-a0c4-853bc697cc3a" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] Acquiring lock "cinder-quobyte-54ba06e6-b0bd-44b0-b5a5-acfd60274fec" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "cinder-quobyte-54ba06e6-b0bd-44b0-b5a5-acfd60274fec" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] Deleting offline snapshot 54ba06e6-b0bd-44b0-b5a5-acfd60274fec of volume 45cf4b6f-a85b-4796-a0c4-853bc697cc3a {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:21:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] snapshot_file for this snap is: volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:21:32 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0a3be2-fcef-4f0a-99e1-0d04b5bf3197]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:32 devstack sudo[99297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec Sep 09 18:21:32 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:32 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.dc7b3ea3-643f-4199-8c96-11dc72e3ea74" returned: 0 in 0.482s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.dc7b3ea3-643f-4199-8c96-11dc72e3ea74 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:32 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.dc7b3ea3-643f-4199-8c96-11dc72e3ea74 Sep 09 18:21:32 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:32 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec" returned: 0 in 0.454s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:21:32 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99ae0fb-0a62-4ea5-aa7f-fb1e15c7e3c5]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:33 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674.dc7b3ea3-643f-4199-8c96-11dc72e3ea74" returned: 0 in 0.325s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] Lock "cinder-quobyte-dc7b3ea3-643f-4199-8c96-11dc72e3ea74" released by "_delete_snapshot" :: held 1.954s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] Lock "cinder-quobyte-189d3f99-d870-4d44-8ce2-d440bec8c674" released by "delete_snapshot" :: held 1.991s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:33 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546 Sep 09 18:21:33 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:33 devstack cinder-volume[87639]: WARNING cinder.quota [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1818914158 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1818914158, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:21:33 devstack cinder-volume[87639]: WARNING cinder.quota [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1818914158 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1818914158, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] Created reservations ['864dbb32-e79c-46cb-a07a-e5f050955cdc', '5bd9c6ef-7db6-41eb-b0b1-dccaa4633cc4', '603469b2-31cf-4a9a-88ea-7b127ac4d1b7', 'fa1e9a72-f55a-4e7e-8808-11853f1c6947'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:21:33 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-e4505861-6c2f-4994-9cf3-a6c8407939ae tempest-GroupSnapshotsV319Test-1791322880 None] group_snapshot e7829e55-495c-4b8b-8c50-c884acd233b3: deleted successfully Sep 09 18:21:33 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546" returned: 0 in 0.477s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:33 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec Sep 09 18:21:33 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Flow 'volume_create_manager' (526ecd14-7f3a-46e5-8ff5-26d0673305b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e94bc1-2207-4bf0-972c-4a6f54cf4a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e94bc1-2207-4bf0-972c-4a6f54cf4a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-433310964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a5f837-b605-43ac-8352-ecfeb9730435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9adc34404c954db3b7f1075cf19b3fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:21:34Z,use_quota=True,user_id='7ee2e5d75b17481cab2697ddae3ce34b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1157a33e-1073-4f3c-98dd-1b596a62f2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1157a33e-1073-4f3c-98dd-1b596a62f2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd868ac-69c6-4ea4-ab58-3c85a7b2285d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dd868ac-69c6-4ea4-ab58-3c85a7b2285d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9a5f837-b605-43ac-8352-ecfeb9730435', 'volume_name': 'volume-e9a5f837-b605-43ac-8352-ecfeb9730435', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d744af6-45ec-4c17-b35b-22edb00ec36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d744af6-45ec-4c17-b35b-22edb00ec36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2106d282-65a4-4041-aed7-f9c693e8c7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:33 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Volume e9a5f837-b605-43ac-8352-ecfeb9730435: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9a5f837-b605-43ac-8352-ecfeb9730435', 'volume_size': 1} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:21:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-433310964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9a5f837-b605-43ac-8352-ecfeb9730435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9adc34404c954db3b7f1075cf19b3fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:21:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:21:34Z,use_quota=True,user_id='7ee2e5d75b17481cab2697ddae3ce34b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Creating volume e9a5f837-b605-43ac-8352-ecfeb9730435 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:21:33 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:33 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435 1073741824 Sep 09 18:21:33 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f771843d-6905-4c89-9848-79fecef19588 tempest-GroupSnapshotsV319Test-1791322880 None] Acquiring lock "cinder-quobyte-189d3f99-d870-4d44-8ce2-d440bec8c674" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f771843d-6905-4c89-9848-79fecef19588 tempest-GroupSnapshotsV319Test-1791322880 None] Lock "cinder-quobyte-189d3f99-d870-4d44-8ce2-d440bec8c674" acquired by "delete_volume" :: waited 0.024s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[41456b27-e971-40bb-9693-019f8c84cbce]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f771843d-6905-4c89-9848-79fecef19588 tempest-GroupSnapshotsV319Test-1791322880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:33 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec" returned: 0 in 0.507s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:33 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec Sep 09 18:21:33 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:34 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674 Sep 09 18:21:34 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:34 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.54ba06e6-b0bd-44b0-b5a5-acfd60274fec" returned: 0 in 0.336s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "cinder-quobyte-54ba06e6-b0bd-44b0-b5a5-acfd60274fec" released by "_delete_snapshot" :: held 1.920s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "cinder-quobyte-45cf4b6f-a85b-4796-a0c4-853bc697cc3a" released by "delete_snapshot" :: held 1.961s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:34 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:34 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435 1073741824" returned: 0 in 0.599s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f771843d-6905-4c89-9848-79fecef19588 tempest-GroupSnapshotsV319Test-1791322880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674" returned: 0 in 0.464s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f771843d-6905-4c89-9848-79fecef19588 tempest-GroupSnapshotsV319Test-1791322880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:34 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674 Sep 09 18:21:34 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:34 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435 Sep 09 18:21:34 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] Created reservations ['5f7c337f-76a1-4f4b-8ba6-c102700406fd', '01659a2a-644a-4ce9-8db0-ab8b28779857', '835832cd-2c22-44b5-885b-0e74e32fa471', '5772ec8d-5b20-439b-bf29-254cf1bf784c'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:21:34 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] Delete snapshot completed successfully. Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a5c29812-7817-461a-931a-c7285313e879 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "cinder-54ba06e6-b0bd-44b0-b5a5-acfd60274fec-delete_snapshot" released by "delete_snapshot" :: held 2.257s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:34 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f771843d-6905-4c89-9848-79fecef19588 tempest-GroupSnapshotsV319Test-1791322880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-189d3f99-d870-4d44-8ce2-d440bec8c674" returned: 0 in 0.279s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f771843d-6905-4c89-9848-79fecef19588 tempest-GroupSnapshotsV319Test-1791322880 None] Lock "cinder-quobyte-189d3f99-d870-4d44-8ce2-d440bec8c674" released by "delete_volume" :: held 0.817s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-f771843d-6905-4c89-9848-79fecef19588 tempest-GroupSnapshotsV319Test-1791322880 None] Created reservations ['33706088-f7dd-4258-88ac-749af73c3fb7'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:21:34 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435" returned: 0 in 0.325s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:34 devstack cinder-volume[87639]: WARNING cinder.quota [None req-f771843d-6905-4c89-9848-79fecef19588 tempest-GroupSnapshotsV319Test-1791322880 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1818914158 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1818914158, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2106d282-65a4-4041-aed7-f9c693e8c7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9a5f837-b605-43ac-8352-ecfeb9730435', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a9bb391-7b35-4825-bdcc-df196111243b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:34 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Volume volume-e9a5f837-b605-43ac-8352-ecfeb9730435 (e9a5f837-b605-43ac-8352-ecfeb9730435): created successfully Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a9bb391-7b35-4825-bdcc-df196111243b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Flow 'volume_create_manager' (526ecd14-7f3a-46e5-8ff5-26d0673305b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:21:34 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-5a4f5cc2-7bc5-43cb-954d-6eaee75207e7 tempest-VolumesCloneTest-10985055 None] Created volume successfully. Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-f771843d-6905-4c89-9848-79fecef19588 tempest-GroupSnapshotsV319Test-1791322880 None] Created reservations ['e84c5908-bfc8-4f2e-aa4a-a674367e9cea', 'dc121f72-10ab-4b61-a083-b42f16890c35', 'fc2a27c6-347b-466b-921e-950c13cad927', '524482fa-aff9-499a-a44f-beb44c3c8ce1'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f771843d-6905-4c89-9848-79fecef19588 tempest-GroupSnapshotsV319Test-1791322880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f771843d-6905-4c89-9848-79fecef19588 tempest-GroupSnapshotsV319Test-1791322880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f771843d-6905-4c89-9848-79fecef19588 tempest-GroupSnapshotsV319Test-1791322880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f771843d-6905-4c89-9848-79fecef19588 tempest-GroupSnapshotsV319Test-1791322880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f771843d-6905-4c89-9848-79fecef19588 tempest-GroupSnapshotsV319Test-1791322880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f771843d-6905-4c89-9848-79fecef19588 tempest-GroupSnapshotsV319Test-1791322880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:34 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:21:34 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Flow 'volume_create_manager' (5689ff9e-2b71-497d-831f-75645c8463d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee55df52-1617-42e0-9344-755c9b602add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee55df52-1617-42e0-9344-755c9b602add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-791968725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66054412-d7a3-4688-ac49-24c9669b2f47,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c91564dae5a046bab478848dab3865c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:21:35Z,use_quota=True,user_id='8a81e699066a481fb103cfe607f867e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb75840-40ab-4def-9803-93e9dd771802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb75840-40ab-4def-9803-93e9dd771802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ff33a5-ef8e-4944-ad46-58e1147bc076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ff33a5-ef8e-4944-ad46-58e1147bc076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66054412-d7a3-4688-ac49-24c9669b2f47', 'volume_name': 'volume-66054412-d7a3-4688-ac49-24c9669b2f47', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639e7aaa-f69b-4265-9a5a-50ccbbb72b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639e7aaa-f69b-4265-9a5a-50ccbbb72b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0304a4f1-e015-413f-9f11-5a96f082406a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:35 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Volume 66054412-d7a3-4688-ac49-24c9669b2f47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66054412-d7a3-4688-ac49-24c9669b2f47', 'volume_size': 1} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-791968725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66054412-d7a3-4688-ac49-24c9669b2f47,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c91564dae5a046bab478848dab3865c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:21:35Z,use_quota=True,user_id='8a81e699066a481fb103cfe607f867e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Creating volume 66054412-d7a3-4688-ac49-24c9669b2f47 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:21:35 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66054412-d7a3-4688-ac49-24c9669b2f47 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:35 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66054412-d7a3-4688-ac49-24c9669b2f47 1073741824 Sep 09 18:21:35 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:35 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f771843d-6905-4c89-9848-79fecef19588 tempest-GroupSnapshotsV319Test-1791322880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.307s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-f771843d-6905-4c89-9848-79fecef19588 tempest-GroupSnapshotsV319Test-1791322880 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:21:35 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-f771843d-6905-4c89-9848-79fecef19588 tempest-GroupSnapshotsV319Test-1791322880 None] Delete group completed successfully. Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-81191ac2-6087-4e30-a37a-1c392d1819e6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Acquiring lock "cinder-db178504-f864-4aed-9a73-f0123e053546-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-81191ac2-6087-4e30-a37a-1c392d1819e6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "cinder-db178504-f864-4aed-9a73-f0123e053546-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-81191ac2-6087-4e30-a37a-1c392d1819e6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Acquiring lock "cinder-quobyte-45cf4b6f-a85b-4796-a0c4-853bc697cc3a" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-81191ac2-6087-4e30-a37a-1c392d1819e6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "cinder-quobyte-45cf4b6f-a85b-4796-a0c4-853bc697cc3a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-81191ac2-6087-4e30-a37a-1c392d1819e6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Acquiring lock "cinder-quobyte-db178504-f864-4aed-9a73-f0123e053546" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-81191ac2-6087-4e30-a37a-1c392d1819e6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "cinder-quobyte-db178504-f864-4aed-9a73-f0123e053546" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-81191ac2-6087-4e30-a37a-1c392d1819e6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Deleting offline snapshot db178504-f864-4aed-9a73-f0123e053546 of volume 45cf4b6f-a85b-4796-a0c4-853bc697cc3a {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-81191ac2-6087-4e30-a37a-1c392d1819e6 tempest-VolumesSnapshotListTestJSON-1265411180 None] snapshot_file for this snap is: volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b827f6-35ca-4181-93d8-907210a0cdc7]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-81191ac2-6087-4e30-a37a-1c392d1819e6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:35 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66054412-d7a3-4688-ac49-24c9669b2f47 1073741824" returned: 0 in 0.538s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66054412-d7a3-4688-ac49-24c9669b2f47 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:35 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66054412-d7a3-4688-ac49-24c9669b2f47 Sep 09 18:21:35 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:35 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546 Sep 09 18:21:35 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:36 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66054412-d7a3-4688-ac49-24c9669b2f47" returned: 0 in 0.355s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:36 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0304a4f1-e015-413f-9f11-5a96f082406a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66054412-d7a3-4688-ac49-24c9669b2f47', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fbca46f-0da1-46f6-9214-8088f930b6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-81191ac2-6087-4e30-a37a-1c392d1819e6 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546" returned: 0 in 0.473s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-81191ac2-6087-4e30-a37a-1c392d1819e6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:21:36 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Volume volume-66054412-d7a3-4688-ac49-24c9669b2f47 (66054412-d7a3-4688-ac49-24c9669b2f47): created successfully Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fbca46f-0da1-46f6-9214-8088f930b6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Flow 'volume_create_manager' (5689ff9e-2b71-497d-831f-75645c8463d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6678d1-23a7-4185-a8df-394d1f0fd40f]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-81191ac2-6087-4e30-a37a-1c392d1819e6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:36 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-65a40dad-b2f2-4ac9-8329-5540c53c0999 tempest-VolumesListTestJSON-1082698111 None] Created volume successfully. Sep 09 18:21:36 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a Sep 09 18:21:36 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Flow 'volume_create_manager' (f9789916-d51a-4ee7-9f0d-06509cf76774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0de5308-3982-4596-af67-bfc9dfd42e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0de5308-3982-4596-af67-bfc9dfd42e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1541683078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc8d296-64ac-449c-9cb0-bf4f19250aed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9adc34404c954db3b7f1075cf19b3fd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:21:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e9a5f837-b605-43ac-8352-ecfeb9730435,status='creating',terminated_at=None,updated_at=2026-09-09T16:21:36Z,use_quota=True,user_id='7ee2e5d75b17481cab2697ddae3ce34b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9d5c8f-71fa-436a-8380-05d50841e7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9d5c8f-71fa-436a-8380-05d50841e7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a873650-79a8-49e5-b0da-e8c5d2c68d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a873650-79a8-49e5-b0da-e8c5d2c68d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3fc8d296-64ac-449c-9cb0-bf4f19250aed', 'volume_name': 'volume-3fc8d296-64ac-449c-9cb0-bf4f19250aed', 'volume_size': 2, 'source_volid': 'e9a5f837-b605-43ac-8352-ecfeb9730435', 'source_volstatus': 'available'}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da8d605-9646-4668-9666-e3c16c2a8a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5da8d605-9646-4668-9666-e3c16c2a8a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (881d2e60-91e7-4bf0-b201-1cc0ccb34b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:36 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Volume 3fc8d296-64ac-449c-9cb0-bf4f19250aed: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3fc8d296-64ac-449c-9cb0-bf4f19250aed', 'volume_size': 2, 'source_volid': 'e9a5f837-b605-43ac-8352-ecfeb9730435', 'source_volstatus': 'available'} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:36 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Cloning volume e9a5f837-b605-43ac-8352-ecfeb9730435 to volume 3fc8d296-64ac-449c-9cb0-bf4f19250aed Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Creating offline snapshot 0489f619-02cd-4b81-b92f-8da7f04fc2df of volume e9a5f837-b605-43ac-8352-ecfeb9730435 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcb22c8-abb2-4888-9ba9-cb543168cafc]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:36 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-81191ac2-6087-4e30-a37a-1c392d1819e6 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a" returned: 0 in 0.425s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-81191ac2-6087-4e30-a37a-1c392d1819e6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:36 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546 Sep 09 18:21:36 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:36 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435 Sep 09 18:21:36 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:36 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-81191ac2-6087-4e30-a37a-1c392d1819e6 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546" returned: 0 in 0.374s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:36 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-81191ac2-6087-4e30-a37a-1c392d1819e6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435" returned: 0 in 0.410s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:37 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546 Sep 09 18:21:37 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:37 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df 1G Sep 09 18:21:37 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:37 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-81191ac2-6087-4e30-a37a-1c392d1819e6 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a.db178504-f864-4aed-9a73-f0123e053546" returned: 0 in 0.328s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-81191ac2-6087-4e30-a37a-1c392d1819e6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "cinder-quobyte-db178504-f864-4aed-9a73-f0123e053546" released by "_delete_snapshot" :: held 1.748s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-81191ac2-6087-4e30-a37a-1c392d1819e6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "cinder-quobyte-45cf4b6f-a85b-4796-a0c4-853bc697cc3a" released by "delete_snapshot" :: held 1.781s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:37 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-81191ac2-6087-4e30-a37a-1c392d1819e6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Created reservations ['e3e02399-9b09-463b-b32b-5d7f0f70f7c3', '1a9d2765-6d4e-464c-8a4b-eb4f4b89da75', 'c0b42f56-aace-4a3e-95e2-329f42d77109', 'e3f2aa11-4b30-45b0-8137-9137a63e5190'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:21:37 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-81191ac2-6087-4e30-a37a-1c392d1819e6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Delete snapshot completed successfully. Sep 09 18:21:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-81191ac2-6087-4e30-a37a-1c392d1819e6 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "cinder-db178504-f864-4aed-9a73-f0123e053546-delete_snapshot" released by "delete_snapshot" :: held 1.949s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:37 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df 1G" returned: 0 in 0.581s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9a5f837-b605-43ac-8352-ecfeb9730435 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:37 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9a5f837-b605-43ac-8352-ecfeb9730435 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df Sep 09 18:21:37 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:37 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:21:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Flow 'volume_create_manager' (366b0f90-357c-4d67-aba8-d88a0c622794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:21:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd37f4a-2139-408f-b338-cc50dd98d626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c013f4ed-13ed-41e8-bbc1-191efa8c4b54 tempest-VolumesSnapshotListTestJSON-1265411180 None] Acquiring lock "cinder-45cf4b6f-a85b-4796-a0c4-853bc697cc3a-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bd37f4a-2139-408f-b338-cc50dd98d626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2028361548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b5ff70-f972-40e4-937b-04a45013d4b1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c91564dae5a046bab478848dab3865c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:21:38Z,use_quota=True,user_id='8a81e699066a481fb103cfe607f867e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46fa2f8b-d474-4582-9f73-4c33a0642527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46fa2f8b-d474-4582-9f73-4c33a0642527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e952875a-f36f-4390-8ce0-aed8b225bf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e952875a-f36f-4390-8ce0-aed8b225bf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9b5ff70-f972-40e4-937b-04a45013d4b1', 'volume_name': 'volume-c9b5ff70-f972-40e4-937b-04a45013d4b1', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724fbb66-ebe8-47e6-bc05-3f46d82c18a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (724fbb66-ebe8-47e6-bc05-3f46d82c18a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac44a1e-2a1b-428d-8fc8-7843ac0e218f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:37 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Volume c9b5ff70-f972-40e4-937b-04a45013d4b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9b5ff70-f972-40e4-937b-04a45013d4b1', 'volume_size': 1} Sep 09 18:21:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c013f4ed-13ed-41e8-bbc1-191efa8c4b54 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "cinder-45cf4b6f-a85b-4796-a0c4-853bc697cc3a-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:38 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c013f4ed-13ed-41e8-bbc1-191efa8c4b54 tempest-VolumesSnapshotListTestJSON-1265411180 None] Acquiring lock "cinder-quobyte-45cf4b6f-a85b-4796-a0c4-853bc697cc3a" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9a5f837-b605-43ac-8352-ecfeb9730435 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df" returned: 0 in 0.436s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:38 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df is being set with open permissions: ugo+rw Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c013f4ed-13ed-41e8-bbc1-191efa8c4b54 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "cinder-quobyte-45cf4b6f-a85b-4796-a0c4-853bc697cc3a" acquired by "delete_volume" :: waited 0.030s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:38 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df Sep 09 18:21:38 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c023d2b7-53fe-4b81-82f9-c466f4ff4b45]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c013f4ed-13ed-41e8-bbc1-191efa8c4b54 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:38 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a Sep 09 18:21:38 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:38 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df" returned: 0 in 0.266s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:38 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.info Sep 09 18:21:38 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:38 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c013f4ed-13ed-41e8-bbc1-191efa8c4b54 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a" returned: 0 in 0.428s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c013f4ed-13ed-41e8-bbc1-191efa8c4b54 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:38 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a Sep 09 18:21:38 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:38 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.info" returned: 0 in 0.285s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:38 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.info is being set with open permissions: ugo+rw Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:38 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.info Sep 09 18:21:38 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:38 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c013f4ed-13ed-41e8-bbc1-191efa8c4b54 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-45cf4b6f-a85b-4796-a0c4-853bc697cc3a" returned: 0 in 0.261s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c013f4ed-13ed-41e8-bbc1-191efa8c4b54 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "cinder-quobyte-45cf4b6f-a85b-4796-a0c4-853bc697cc3a" released by "delete_volume" :: held 0.747s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-c013f4ed-13ed-41e8-bbc1-191efa8c4b54 tempest-VolumesSnapshotListTestJSON-1265411180 None] Created reservations ['698efa76-2ef7-4746-bc40-9be29d8f4abc', 'fbc6234b-008c-4ec8-87df-b8037c55aa80', 'c7dcd084-a95e-47e1-a34a-8649be70cb4b', 'c9bf4d38-21bb-4a8d-bcd6-c89b14033d6f'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:21:38 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.info" returned: 0 in 0.272s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Acquiring lock "cinder-quobyte-3fc8d296-64ac-449c-9cb0-bf4f19250aed" by "_copy_volume_from_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Lock "cinder-quobyte-3fc8d296-64ac-449c-9cb0-bf4f19250aed" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] snapshot: 0489f619-02cd-4b81-b92f-8da7f04fc2df, volume: 3fc8d296-64ac-449c-9cb0-bf4f19250aed, {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c28207-3821-4d03-a3b7-ad9b7e4eca25]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c013f4ed-13ed-41e8-bbc1-191efa8c4b54 tempest-VolumesSnapshotListTestJSON-1265411180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c013f4ed-13ed-41e8-bbc1-191efa8c4b54 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c013f4ed-13ed-41e8-bbc1-191efa8c4b54 tempest-VolumesSnapshotListTestJSON-1265411180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c013f4ed-13ed-41e8-bbc1-191efa8c4b54 tempest-VolumesSnapshotListTestJSON-1265411180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c013f4ed-13ed-41e8-bbc1-191efa8c4b54 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c013f4ed-13ed-41e8-bbc1-191efa8c4b54 tempest-VolumesSnapshotListTestJSON-1265411180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:39 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:21:39 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:39 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df Sep 09 18:21:39 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:39 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c013f4ed-13ed-41e8-bbc1-191efa8c4b54 tempest-VolumesSnapshotListTestJSON-1265411180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.325s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:39 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-c013f4ed-13ed-41e8-bbc1-191efa8c4b54 tempest-VolumesSnapshotListTestJSON-1265411180 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:21:39 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-c013f4ed-13ed-41e8-bbc1-191efa8c4b54 tempest-VolumesSnapshotListTestJSON-1265411180 None] Deleted volume successfully. Sep 09 18:21:39 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c013f4ed-13ed-41e8-bbc1-191efa8c4b54 tempest-VolumesSnapshotListTestJSON-1265411180 None] Lock "cinder-45cf4b6f-a85b-4796-a0c4-853bc697cc3a-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:39 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df" returned: 0 in 0.475s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9a5f837-b605-43ac-8352-ecfeb9730435(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:21:39 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[5386ddab-ffd3-48c2-85ae-d93afbc0aaed]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:39 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435 Sep 09 18:21:39 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:39 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435" returned: 0 in 0.433s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435 {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 18:21:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Creating direct copy from snapshot {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 18:21:39 devstack cinder-volume[87639]: DEBUG cinder.utils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Path /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3fc8d296-64ac-449c-9cb0-bf4f19250aed not found in is_blk_device check {{(pid=87639) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 18:21:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3fc8d296-64ac-449c-9cb0-bf4f19250aed {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:39 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3fc8d296-64ac-449c-9cb0-bf4f19250aed Sep 09 18:21:39 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:21:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:21:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:21:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:43 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:21:43 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:43 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.508s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:21:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:21:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 29 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:21:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:21:45 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3fc8d296-64ac-449c-9cb0-bf4f19250aed" returned: 0 in 5.186s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:45 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Image conversion details: src /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435, size 1024.00 MB, duration 5.19 sec, destination /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3fc8d296-64ac-449c-9cb0-bf4f19250aed {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:21:45 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Converted 1024.00 MB image at 197.42 MB/s Sep 09 18:21:45 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3fc8d296-64ac-449c-9cb0-bf4f19250aed is being set with open permissions: ugo+rw Sep 09 18:21:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3fc8d296-64ac-449c-9cb0-bf4f19250aed {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:45 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3fc8d296-64ac-449c-9cb0-bf4f19250aed Sep 09 18:21:45 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:45 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3fc8d296-64ac-449c-9cb0-bf4f19250aed" returned: 0 in 0.281s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Lock "cinder-quobyte-3fc8d296-64ac-449c-9cb0-bf4f19250aed" released by "_copy_volume_from_snapshot" :: held 6.467s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Acquiring lock "cinder-quobyte-0489f619-02cd-4b81-b92f-8da7f04fc2df" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Lock "cinder-quobyte-0489f619-02cd-4b81-b92f-8da7f04fc2df" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Deleting offline snapshot 0489f619-02cd-4b81-b92f-8da7f04fc2df of volume e9a5f837-b605-43ac-8352-ecfeb9730435 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:21:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] snapshot_file for this snap is: volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:21:45 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bd475f-8b14-4715-8f85-f8149991cf2d]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:45 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df Sep 09 18:21:45 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:45 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df" returned: 0 in 0.444s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9a5f837-b605-43ac-8352-ecfeb9730435(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:21:45 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[2673c8c8-a311-4d47-8227-18cdc24f180a]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:46 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435 Sep 09 18:21:46 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:46 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435" returned: 0 in 0.597s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:46 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df Sep 09 18:21:46 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:46 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df" returned: 0 in 0.452s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:47 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df Sep 09 18:21:47 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:47 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435.0489f619-02cd-4b81-b92f-8da7f04fc2df" returned: 0 in 0.274s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:47 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Lock "cinder-quobyte-0489f619-02cd-4b81-b92f-8da7f04fc2df" released by "_delete_snapshot" :: held 1.904s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.839s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.405s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2028361548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b5ff70-f972-40e4-937b-04a45013d4b1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c91564dae5a046bab478848dab3865c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:21:38Z,use_quota=True,user_id='8a81e699066a481fb103cfe607f867e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:21:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Creating volume c9b5ff70-f972-40e4-937b-04a45013d4b1 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:21:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:21:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:21:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:21:47 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:21:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c9b5ff70-f972-40e4-937b-04a45013d4b1 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (881d2e60-91e7-4bf0-b201-1cc0ccb34b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc8d296-64ac-449c-9cb0-bf4f19250aed', 'volume_size': 2, 'source_volid': 'e9a5f837-b605-43ac-8352-ecfeb9730435', 'source_volstatus': 'available'}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d875b472-ec01-47f3-9376-215cab584f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:47 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c9b5ff70-f972-40e4-937b-04a45013d4b1 1073741824 Sep 09 18:21:47 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:47 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Volume volume-3fc8d296-64ac-449c-9cb0-bf4f19250aed (3fc8d296-64ac-449c-9cb0-bf4f19250aed): created successfully Sep 09 18:21:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d875b472-ec01-47f3-9376-215cab584f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Flow 'volume_create_manager' (f9789916-d51a-4ee7-9f0d-06509cf76774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:21:47 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-9eb3f609-cc19-48ed-b52e-983df169ef9d tempest-VolumesCloneTest-10985055 None] Created volume successfully. Sep 09 18:21:47 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c9b5ff70-f972-40e4-937b-04a45013d4b1 1073741824" returned: 0 in 0.511s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c9b5ff70-f972-40e4-937b-04a45013d4b1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:47 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c9b5ff70-f972-40e4-937b-04a45013d4b1 Sep 09 18:21:47 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:48 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c9b5ff70-f972-40e4-937b-04a45013d4b1" returned: 0 in 0.286s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:21:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac44a1e-2a1b-428d-8fc8-7843ac0e218f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9b5ff70-f972-40e4-937b-04a45013d4b1', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80590e65-b115-4fc9-a127-41d4c3e6e131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:48 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Volume volume-c9b5ff70-f972-40e4-937b-04a45013d4b1 (c9b5ff70-f972-40e4-937b-04a45013d4b1): created successfully Sep 09 18:21:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80590e65-b115-4fc9-a127-41d4c3e6e131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Flow 'volume_create_manager' (366b0f90-357c-4d67-aba8-d88a0c622794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:21:48 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-29a825b4-21ff-494c-9bb6-c96fc7600e3c tempest-VolumesListTestJSON-1082698111 None] Created volume successfully. Sep 09 18:21:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4ed1deb7-b6db-44fb-8140-5c3133bb2bee tempest-VolumesCloneTest-10985055 None] Acquiring lock "cinder-3fc8d296-64ac-449c-9cb0-bf4f19250aed-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4ed1deb7-b6db-44fb-8140-5c3133bb2bee tempest-VolumesCloneTest-10985055 None] Lock "cinder-3fc8d296-64ac-449c-9cb0-bf4f19250aed-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4ed1deb7-b6db-44fb-8140-5c3133bb2bee tempest-VolumesCloneTest-10985055 None] Acquiring lock "cinder-quobyte-3fc8d296-64ac-449c-9cb0-bf4f19250aed" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4ed1deb7-b6db-44fb-8140-5c3133bb2bee tempest-VolumesCloneTest-10985055 None] Lock "cinder-quobyte-3fc8d296-64ac-449c-9cb0-bf4f19250aed" acquired by "delete_volume" :: waited 0.029s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6e1c1a-4aa9-4a3c-92f8-ecedac59c1f2]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4ed1deb7-b6db-44fb-8140-5c3133bb2bee tempest-VolumesCloneTest-10985055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3fc8d296-64ac-449c-9cb0-bf4f19250aed {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:49 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3fc8d296-64ac-449c-9cb0-bf4f19250aed Sep 09 18:21:49 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:49 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4ed1deb7-b6db-44fb-8140-5c3133bb2bee tempest-VolumesCloneTest-10985055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3fc8d296-64ac-449c-9cb0-bf4f19250aed" returned: 0 in 0.551s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4ed1deb7-b6db-44fb-8140-5c3133bb2bee tempest-VolumesCloneTest-10985055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3fc8d296-64ac-449c-9cb0-bf4f19250aed {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:49 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3fc8d296-64ac-449c-9cb0-bf4f19250aed Sep 09 18:21:49 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Flow 'volume_create_manager' (f5dbda8a-9161-4807-8b38-1856c7aa207b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c608cb-cf0e-4e6f-9c9f-7d577a969c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c608cb-cf0e-4e6f-9c9f-7d577a969c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-726982439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d484a60-6dc2-430e-8780-ca7f7935d3f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c91564dae5a046bab478848dab3865c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:21:50Z,use_quota=True,user_id='8a81e699066a481fb103cfe607f867e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2b8ec0-1003-4b32-8bfd-3a2b49eae72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f2b8ec0-1003-4b32-8bfd-3a2b49eae72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9e61fd-3b08-47ba-bcbe-2c04f2230be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9e61fd-3b08-47ba-bcbe-2c04f2230be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d484a60-6dc2-430e-8780-ca7f7935d3f0', 'volume_name': 'volume-2d484a60-6dc2-430e-8780-ca7f7935d3f0', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98750e9e-bd90-4daa-acee-4b107925a896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98750e9e-bd90-4daa-acee-4b107925a896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf65bb51-fa14-4ece-8c93-625478fbf39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:49 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Volume 2d484a60-6dc2-430e-8780-ca7f7935d3f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d484a60-6dc2-430e-8780-ca7f7935d3f0', 'volume_size': 1} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-726982439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d484a60-6dc2-430e-8780-ca7f7935d3f0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c91564dae5a046bab478848dab3865c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:21:50Z,use_quota=True,user_id='8a81e699066a481fb103cfe607f867e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Creating volume 2d484a60-6dc2-430e-8780-ca7f7935d3f0 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:21:49 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2d484a60-6dc2-430e-8780-ca7f7935d3f0 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:49 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:49 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2d484a60-6dc2-430e-8780-ca7f7935d3f0 1073741824 Sep 09 18:21:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4ed1deb7-b6db-44fb-8140-5c3133bb2bee tempest-VolumesCloneTest-10985055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3fc8d296-64ac-449c-9cb0-bf4f19250aed" returned: 0 in 0.319s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:49 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4ed1deb7-b6db-44fb-8140-5c3133bb2bee tempest-VolumesCloneTest-10985055 None] Lock "cinder-quobyte-3fc8d296-64ac-449c-9cb0-bf4f19250aed" released by "delete_volume" :: held 0.936s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:50 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-4ed1deb7-b6db-44fb-8140-5c3133bb2bee tempest-VolumesCloneTest-10985055 None] Created reservations ['82852184-8a2f-4473-b78d-446da320c206', 'e60c4bfe-3e41-4d89-9e48-5757320f74de', '089010f5-9ac3-473e-bf03-05cabc0521c4', '137044ec-979b-4d39-bf50-99345f50e7b1'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:21:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4ed1deb7-b6db-44fb-8140-5c3133bb2bee tempest-VolumesCloneTest-10985055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4ed1deb7-b6db-44fb-8140-5c3133bb2bee tempest-VolumesCloneTest-10985055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4ed1deb7-b6db-44fb-8140-5c3133bb2bee tempest-VolumesCloneTest-10985055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:21:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4ed1deb7-b6db-44fb-8140-5c3133bb2bee tempest-VolumesCloneTest-10985055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:21:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4ed1deb7-b6db-44fb-8140-5c3133bb2bee tempest-VolumesCloneTest-10985055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4ed1deb7-b6db-44fb-8140-5c3133bb2bee tempest-VolumesCloneTest-10985055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:50 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:21:50 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e51699b3-e715-4cf4-b7d5-9f84c1526bff tempest-VolumesCloneTest-10985055 None] Acquiring lock "cinder-e9a5f837-b605-43ac-8352-ecfeb9730435-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e51699b3-e715-4cf4-b7d5-9f84c1526bff tempest-VolumesCloneTest-10985055 None] Lock "cinder-e9a5f837-b605-43ac-8352-ecfeb9730435-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e51699b3-e715-4cf4-b7d5-9f84c1526bff tempest-VolumesCloneTest-10985055 None] Acquiring lock "cinder-quobyte-e9a5f837-b605-43ac-8352-ecfeb9730435" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e51699b3-e715-4cf4-b7d5-9f84c1526bff tempest-VolumesCloneTest-10985055 None] Lock "cinder-quobyte-e9a5f837-b605-43ac-8352-ecfeb9730435" acquired by "delete_volume" :: waited 0.025s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:50 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2545d10-017c-4c59-a3b4-5c68ede93d42]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e51699b3-e715-4cf4-b7d5-9f84c1526bff tempest-VolumesCloneTest-10985055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:50 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4ed1deb7-b6db-44fb-8140-5c3133bb2bee tempest-VolumesCloneTest-10985055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.417s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:50 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-4ed1deb7-b6db-44fb-8140-5c3133bb2bee tempest-VolumesCloneTest-10985055 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:21:50 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-4ed1deb7-b6db-44fb-8140-5c3133bb2bee tempest-VolumesCloneTest-10985055 None] Deleted volume successfully. Sep 09 18:21:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4ed1deb7-b6db-44fb-8140-5c3133bb2bee tempest-VolumesCloneTest-10985055 None] Lock "cinder-3fc8d296-64ac-449c-9cb0-bf4f19250aed-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:50 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435 Sep 09 18:21:50 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:50 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2d484a60-6dc2-430e-8780-ca7f7935d3f0 1073741824" returned: 0 in 0.796s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2d484a60-6dc2-430e-8780-ca7f7935d3f0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:50 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2d484a60-6dc2-430e-8780-ca7f7935d3f0 Sep 09 18:21:50 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:50 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e51699b3-e715-4cf4-b7d5-9f84c1526bff tempest-VolumesCloneTest-10985055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435" returned: 0 in 0.442s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e51699b3-e715-4cf4-b7d5-9f84c1526bff tempest-VolumesCloneTest-10985055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:51 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435 Sep 09 18:21:51 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:51 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2d484a60-6dc2-430e-8780-ca7f7935d3f0" returned: 0 in 0.307s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:21:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf65bb51-fa14-4ece-8c93-625478fbf39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d484a60-6dc2-430e-8780-ca7f7935d3f0', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94c8fdbf-9c0e-4c05-a285-efebaccdcfa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:51 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Volume volume-2d484a60-6dc2-430e-8780-ca7f7935d3f0 (2d484a60-6dc2-430e-8780-ca7f7935d3f0): created successfully Sep 09 18:21:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94c8fdbf-9c0e-4c05-a285-efebaccdcfa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Flow 'volume_create_manager' (f5dbda8a-9161-4807-8b38-1856c7aa207b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:21:51 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-50b6475a-5d28-47e3-9119-33d179748c5a tempest-VolumesListTestJSON-1082698111 None] Created volume successfully. Sep 09 18:21:51 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e51699b3-e715-4cf4-b7d5-9f84c1526bff tempest-VolumesCloneTest-10985055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e9a5f837-b605-43ac-8352-ecfeb9730435" returned: 0 in 0.292s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e51699b3-e715-4cf4-b7d5-9f84c1526bff tempest-VolumesCloneTest-10985055 None] Lock "cinder-quobyte-e9a5f837-b605-43ac-8352-ecfeb9730435" released by "delete_volume" :: held 0.820s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:51 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-e51699b3-e715-4cf4-b7d5-9f84c1526bff tempest-VolumesCloneTest-10985055 None] Created reservations ['0df27a03-2386-4852-9516-232e37802bc0', 'debd5752-e48f-450b-b116-b18a634ecda4', '703bfe59-15d0-46c4-a1ab-9ad4ffc108fd', 'e328972a-56ce-435c-a145-e1036d2623ed'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:21:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e51699b3-e715-4cf4-b7d5-9f84c1526bff tempest-VolumesCloneTest-10985055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e51699b3-e715-4cf4-b7d5-9f84c1526bff tempest-VolumesCloneTest-10985055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e51699b3-e715-4cf4-b7d5-9f84c1526bff tempest-VolumesCloneTest-10985055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:21:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e51699b3-e715-4cf4-b7d5-9f84c1526bff tempest-VolumesCloneTest-10985055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:21:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e51699b3-e715-4cf4-b7d5-9f84c1526bff tempest-VolumesCloneTest-10985055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e51699b3-e715-4cf4-b7d5-9f84c1526bff tempest-VolumesCloneTest-10985055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:51 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:21:51 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:51 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e51699b3-e715-4cf4-b7d5-9f84c1526bff tempest-VolumesCloneTest-10985055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.378s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:51 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-e51699b3-e715-4cf4-b7d5-9f84c1526bff tempest-VolumesCloneTest-10985055 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:21:51 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-e51699b3-e715-4cf4-b7d5-9f84c1526bff tempest-VolumesCloneTest-10985055 None] Deleted volume successfully. Sep 09 18:21:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e51699b3-e715-4cf4-b7d5-9f84c1526bff tempest-VolumesCloneTest-10985055 None] Lock "cinder-e9a5f837-b605-43ac-8352-ecfeb9730435-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9965c2ed-eae4-4564-b628-0ced1e4089d6 tempest-VolumesListTestJSON-1082698111 None] Acquiring lock "cinder-2d484a60-6dc2-430e-8780-ca7f7935d3f0-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9965c2ed-eae4-4564-b628-0ced1e4089d6 tempest-VolumesListTestJSON-1082698111 None] Lock "cinder-2d484a60-6dc2-430e-8780-ca7f7935d3f0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9965c2ed-eae4-4564-b628-0ced1e4089d6 tempest-VolumesListTestJSON-1082698111 None] Acquiring lock "cinder-quobyte-2d484a60-6dc2-430e-8780-ca7f7935d3f0" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9965c2ed-eae4-4564-b628-0ced1e4089d6 tempest-VolumesListTestJSON-1082698111 None] Lock "cinder-quobyte-2d484a60-6dc2-430e-8780-ca7f7935d3f0" acquired by "delete_volume" :: waited 0.040s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:55 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f06b8a-4f78-4bb9-adc4-706a5b38db95]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9965c2ed-eae4-4564-b628-0ced1e4089d6 tempest-VolumesListTestJSON-1082698111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2d484a60-6dc2-430e-8780-ca7f7935d3f0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:55 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2d484a60-6dc2-430e-8780-ca7f7935d3f0 Sep 09 18:21:55 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:55 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9965c2ed-eae4-4564-b628-0ced1e4089d6 tempest-VolumesListTestJSON-1082698111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2d484a60-6dc2-430e-8780-ca7f7935d3f0" returned: 0 in 0.524s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9965c2ed-eae4-4564-b628-0ced1e4089d6 tempest-VolumesListTestJSON-1082698111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2d484a60-6dc2-430e-8780-ca7f7935d3f0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:55 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2d484a60-6dc2-430e-8780-ca7f7935d3f0 Sep 09 18:21:55 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:56 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9965c2ed-eae4-4564-b628-0ced1e4089d6 tempest-VolumesListTestJSON-1082698111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2d484a60-6dc2-430e-8780-ca7f7935d3f0" returned: 0 in 0.381s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:56 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9965c2ed-eae4-4564-b628-0ced1e4089d6 tempest-VolumesListTestJSON-1082698111 None] Lock "cinder-quobyte-2d484a60-6dc2-430e-8780-ca7f7935d3f0" released by "delete_volume" :: held 0.972s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:56 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-9965c2ed-eae4-4564-b628-0ced1e4089d6 tempest-VolumesListTestJSON-1082698111 None] Created reservations ['06ff7d02-8d9d-4517-b5c2-cef96b55abd7', '7b9bb162-ad6b-4981-8045-728485dca165', '64385a8f-3a7e-4cee-b78a-b3526a2061a6', 'e1bd9acc-6dd5-44c7-b0c8-851d496f6b45'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:21:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9965c2ed-eae4-4564-b628-0ced1e4089d6 tempest-VolumesListTestJSON-1082698111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9965c2ed-eae4-4564-b628-0ced1e4089d6 tempest-VolumesListTestJSON-1082698111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-9965c2ed-eae4-4564-b628-0ced1e4089d6 tempest-VolumesListTestJSON-1082698111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:21:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-9965c2ed-eae4-4564-b628-0ced1e4089d6 tempest-VolumesListTestJSON-1082698111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:21:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9965c2ed-eae4-4564-b628-0ced1e4089d6 tempest-VolumesListTestJSON-1082698111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9965c2ed-eae4-4564-b628-0ced1e4089d6 tempest-VolumesListTestJSON-1082698111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:56 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:21:56 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:56 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9965c2ed-eae4-4564-b628-0ced1e4089d6 tempest-VolumesListTestJSON-1082698111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.292s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:56 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-9965c2ed-eae4-4564-b628-0ced1e4089d6 tempest-VolumesListTestJSON-1082698111 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:21:56 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-9965c2ed-eae4-4564-b628-0ced1e4089d6 tempest-VolumesListTestJSON-1082698111 None] Deleted volume successfully. Sep 09 18:21:56 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9965c2ed-eae4-4564-b628-0ced1e4089d6 tempest-VolumesListTestJSON-1082698111 None] Lock "cinder-2d484a60-6dc2-430e-8780-ca7f7935d3f0-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Flow 'volume_create_manager' (8148b487-489d-479b-b45c-72cbf2b04331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3285cfc9-d273-4e8c-bc8d-e93ddb47c92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3285cfc9-d273-4e8c-bc8d-e93ddb47c92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-949828306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef94710-5bb4-4ca9-848f-4c45da527ccc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7d3ce03c12284a488de533e75a8321b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:21:57Z,use_quota=True,user_id='3dd44c266c384085b5d209600e46aa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c55593-03df-4085-a1ef-a984b7881e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c55593-03df-4085-a1ef-a984b7881e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c694426f-3973-4a50-8949-39a491eed835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c694426f-3973-4a50-8949-39a491eed835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ef94710-5bb4-4ca9-848f-4c45da527ccc', 'volume_name': 'volume-3ef94710-5bb4-4ca9-848f-4c45da527ccc', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b4ab58-2075-4b0e-9345-7e352f13fec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b4ab58-2075-4b0e-9345-7e352f13fec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45c5a3c0-6df0-414f-ac6d-409159a88c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:57 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Volume 3ef94710-5bb4-4ca9-848f-4c45da527ccc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ef94710-5bb4-4ca9-848f-4c45da527ccc', 'volume_size': 1} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-949828306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef94710-5bb4-4ca9-848f-4c45da527ccc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7d3ce03c12284a488de533e75a8321b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:21:57Z,use_quota=True,user_id='3dd44c266c384085b5d209600e46aa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Creating volume 3ef94710-5bb4-4ca9-848f-4c45da527ccc {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:21:57 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ef94710-5bb4-4ca9-848f-4c45da527ccc 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:57 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ef94710-5bb4-4ca9-848f-4c45da527ccc 1073741824 Sep 09 18:21:57 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4eae863b-4eb8-467c-b563-52e18f74e840 tempest-VolumesListTestJSON-1082698111 None] Acquiring lock "cinder-c9b5ff70-f972-40e4-937b-04a45013d4b1-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4eae863b-4eb8-467c-b563-52e18f74e840 tempest-VolumesListTestJSON-1082698111 None] Lock "cinder-c9b5ff70-f972-40e4-937b-04a45013d4b1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4eae863b-4eb8-467c-b563-52e18f74e840 tempest-VolumesListTestJSON-1082698111 None] Acquiring lock "cinder-quobyte-c9b5ff70-f972-40e4-937b-04a45013d4b1" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4eae863b-4eb8-467c-b563-52e18f74e840 tempest-VolumesListTestJSON-1082698111 None] Lock "cinder-quobyte-c9b5ff70-f972-40e4-937b-04a45013d4b1" acquired by "delete_volume" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1310ef-e11c-4738-b5c4-0fe89014c0e8]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4eae863b-4eb8-467c-b563-52e18f74e840 tempest-VolumesListTestJSON-1082698111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c9b5ff70-f972-40e4-937b-04a45013d4b1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:57 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ef94710-5bb4-4ca9-848f-4c45da527ccc 1073741824" returned: 0 in 0.563s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ef94710-5bb4-4ca9-848f-4c45da527ccc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:57 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ef94710-5bb4-4ca9-848f-4c45da527ccc Sep 09 18:21:57 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:57 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c9b5ff70-f972-40e4-937b-04a45013d4b1 Sep 09 18:21:57 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:58 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ef94710-5bb4-4ca9-848f-4c45da527ccc" returned: 0 in 0.331s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:58 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:21:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:58 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45c5a3c0-6df0-414f-ac6d-409159a88c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ef94710-5bb4-4ca9-848f-4c45da527ccc', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:58 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908eb6ff-6c4a-412c-9d3c-2e7f248d6eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:21:58 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Volume volume-3ef94710-5bb4-4ca9-848f-4c45da527ccc (3ef94710-5bb4-4ca9-848f-4c45da527ccc): created successfully Sep 09 18:21:58 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (908eb6ff-6c4a-412c-9d3c-2e7f248d6eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:21:58 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Flow 'volume_create_manager' (8148b487-489d-479b-b45c-72cbf2b04331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:21:58 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-bfa0957a-2a1d-4912-91f4-3dec2b15d92a tempest-VolumesGetTest-107668911 None] Created volume successfully. Sep 09 18:21:58 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4eae863b-4eb8-467c-b563-52e18f74e840 tempest-VolumesListTestJSON-1082698111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c9b5ff70-f972-40e4-937b-04a45013d4b1" returned: 0 in 0.568s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4eae863b-4eb8-467c-b563-52e18f74e840 tempest-VolumesListTestJSON-1082698111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c9b5ff70-f972-40e4-937b-04a45013d4b1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:58 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c9b5ff70-f972-40e4-937b-04a45013d4b1 Sep 09 18:21:58 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:58 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4eae863b-4eb8-467c-b563-52e18f74e840 tempest-VolumesListTestJSON-1082698111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c9b5ff70-f972-40e4-937b-04a45013d4b1" returned: 0 in 0.280s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:58 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4eae863b-4eb8-467c-b563-52e18f74e840 tempest-VolumesListTestJSON-1082698111 None] Lock "cinder-quobyte-c9b5ff70-f972-40e4-937b-04a45013d4b1" released by "delete_volume" :: held 0.899s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:58 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-4eae863b-4eb8-467c-b563-52e18f74e840 tempest-VolumesListTestJSON-1082698111 None] Created reservations ['898f3f13-fe5d-4ae8-9976-74a64073bd31', '3427bedb-b858-4d67-8bd1-36d4f79fb689', '17941df7-3076-4d94-a2a4-335999d5bf56', '8ce6feed-4315-47bc-a9ca-70123f4fdc40'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:21:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4eae863b-4eb8-467c-b563-52e18f74e840 tempest-VolumesListTestJSON-1082698111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:21:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4eae863b-4eb8-467c-b563-52e18f74e840 tempest-VolumesListTestJSON-1082698111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:21:58 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4eae863b-4eb8-467c-b563-52e18f74e840 tempest-VolumesListTestJSON-1082698111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:21:58 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4eae863b-4eb8-467c-b563-52e18f74e840 tempest-VolumesListTestJSON-1082698111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:21:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4eae863b-4eb8-467c-b563-52e18f74e840 tempest-VolumesListTestJSON-1082698111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:21:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4eae863b-4eb8-467c-b563-52e18f74e840 tempest-VolumesListTestJSON-1082698111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:58 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:21:58 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:59 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-907d1c81-ba37-4814-8fdd-bae343fab766 tempest-VolumesListTestJSON-1082698111 None] Acquiring lock "cinder-66054412-d7a3-4688-ac49-24c9669b2f47-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:59 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-907d1c81-ba37-4814-8fdd-bae343fab766 tempest-VolumesListTestJSON-1082698111 None] Lock "cinder-66054412-d7a3-4688-ac49-24c9669b2f47-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:59 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-907d1c81-ba37-4814-8fdd-bae343fab766 tempest-VolumesListTestJSON-1082698111 None] Acquiring lock "cinder-quobyte-66054412-d7a3-4688-ac49-24c9669b2f47" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:21:59 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-907d1c81-ba37-4814-8fdd-bae343fab766 tempest-VolumesListTestJSON-1082698111 None] Lock "cinder-quobyte-66054412-d7a3-4688-ac49-24c9669b2f47" acquired by "delete_volume" :: waited 0.022s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:21:59 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fbd195-aab2-463a-b70a-977bbad44f3c]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:21:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-907d1c81-ba37-4814-8fdd-bae343fab766 tempest-VolumesListTestJSON-1082698111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66054412-d7a3-4688-ac49-24c9669b2f47 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:59 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4eae863b-4eb8-467c-b563-52e18f74e840 tempest-VolumesListTestJSON-1082698111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.425s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:59 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-4eae863b-4eb8-467c-b563-52e18f74e840 tempest-VolumesListTestJSON-1082698111 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:21:59 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-4eae863b-4eb8-467c-b563-52e18f74e840 tempest-VolumesListTestJSON-1082698111 None] Deleted volume successfully. Sep 09 18:21:59 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4eae863b-4eb8-467c-b563-52e18f74e840 tempest-VolumesListTestJSON-1082698111 None] Lock "cinder-c9b5ff70-f972-40e4-937b-04a45013d4b1-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:21:59 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66054412-d7a3-4688-ac49-24c9669b2f47 Sep 09 18:21:59 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:21:59 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Sep 09 18:21:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-907d1c81-ba37-4814-8fdd-bae343fab766 tempest-VolumesListTestJSON-1082698111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66054412-d7a3-4688-ac49-24c9669b2f47" returned: 0 in 0.632s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:21:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-907d1c81-ba37-4814-8fdd-bae343fab766 tempest-VolumesListTestJSON-1082698111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66054412-d7a3-4688-ac49-24c9669b2f47 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:21:59 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66054412-d7a3-4688-ac49-24c9669b2f47 Sep 09 18:21:59 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:00 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-907d1c81-ba37-4814-8fdd-bae343fab766 tempest-VolumesListTestJSON-1082698111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66054412-d7a3-4688-ac49-24c9669b2f47" returned: 0 in 0.334s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-907d1c81-ba37-4814-8fdd-bae343fab766 tempest-VolumesListTestJSON-1082698111 None] Lock "cinder-quobyte-66054412-d7a3-4688-ac49-24c9669b2f47" released by "delete_volume" :: held 1.035s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-907d1c81-ba37-4814-8fdd-bae343fab766 tempest-VolumesListTestJSON-1082698111 None] Created reservations ['839df132-7259-4f94-9c53-f4f2d310243d', '98cbb1d5-f7b1-42cd-8a54-637d7a4e19ff', '6435abcd-7d83-4ce3-ba45-39be67fa1007', 'caaa3985-e54a-4255-8dc8-3d96c178c95a'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-907d1c81-ba37-4814-8fdd-bae343fab766 tempest-VolumesListTestJSON-1082698111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-907d1c81-ba37-4814-8fdd-bae343fab766 tempest-VolumesListTestJSON-1082698111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-907d1c81-ba37-4814-8fdd-bae343fab766 tempest-VolumesListTestJSON-1082698111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-907d1c81-ba37-4814-8fdd-bae343fab766 tempest-VolumesListTestJSON-1082698111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-907d1c81-ba37-4814-8fdd-bae343fab766 tempest-VolumesListTestJSON-1082698111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-907d1c81-ba37-4814-8fdd-bae343fab766 tempest-VolumesListTestJSON-1082698111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:00 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:22:00 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:00 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-907d1c81-ba37-4814-8fdd-bae343fab766 tempest-VolumesListTestJSON-1082698111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.333s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-907d1c81-ba37-4814-8fdd-bae343fab766 tempest-VolumesListTestJSON-1082698111 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:22:00 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-907d1c81-ba37-4814-8fdd-bae343fab766 tempest-VolumesListTestJSON-1082698111 None] Deleted volume successfully. Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-907d1c81-ba37-4814-8fdd-bae343fab766 tempest-VolumesListTestJSON-1082698111 None] Lock "cinder-66054412-d7a3-4688-ac49-24c9669b2f47-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Flow 'volume_create_manager' (83a3c51f-75cf-4991-baf6-b345dee89934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3e812d-c84b-4769-88a2-f1be3c54fbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3e812d-c84b-4769-88a2-f1be3c54fbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-768999524',display_name='tempest-VolumesGetTest-Volume-22860149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e40a01-ff14-4300-800d-c3251aba3a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d3ce03c12284a488de533e75a8321b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:01Z,use_quota=True,user_id='3dd44c266c384085b5d209600e46aa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66f48e2-88fa-4f6a-b8b0-f94d0a0ed1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f66f48e2-88fa-4f6a-b8b0-f94d0a0ed1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (664f8cf1-ba24-4391-9066-496ac93d8c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (664f8cf1-ba24-4391-9066-496ac93d8c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9e40a01-ff14-4300-800d-c3251aba3a96', 'volume_name': 'volume-a9e40a01-ff14-4300-800d-c3251aba3a96', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24858b8e-7908-4f18-a3d0-6272cc2be8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24858b8e-7908-4f18-a3d0-6272cc2be8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7755a05b-d792-4bd4-8e83-a6b4055f8889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:00 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Volume a9e40a01-ff14-4300-800d-c3251aba3a96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9e40a01-ff14-4300-800d-c3251aba3a96', 'volume_size': 1} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-768999524',display_name='tempest-VolumesGetTest-Volume-22860149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e40a01-ff14-4300-800d-c3251aba3a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d3ce03c12284a488de533e75a8321b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:01Z,use_quota=True,user_id='3dd44c266c384085b5d209600e46aa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Creating volume a9e40a01-ff14-4300-800d-c3251aba3a96 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:22:00 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:22:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a9e40a01-ff14-4300-800d-c3251aba3a96 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:00 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a9e40a01-ff14-4300-800d-c3251aba3a96 1073741824 Sep 09 18:22:00 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:01 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a9e40a01-ff14-4300-800d-c3251aba3a96 1073741824" returned: 0 in 0.619s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a9e40a01-ff14-4300-800d-c3251aba3a96 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:01 devstack sudo[99552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a9e40a01-ff14-4300-800d-c3251aba3a96 Sep 09 18:22:01 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:01 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a9e40a01-ff14-4300-800d-c3251aba3a96" returned: 0 in 0.323s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:22:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7755a05b-d792-4bd4-8e83-a6b4055f8889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9e40a01-ff14-4300-800d-c3251aba3a96', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b92372-8bff-4bc0-8e73-9aaf1d692d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:01 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Volume volume-a9e40a01-ff14-4300-800d-c3251aba3a96 (a9e40a01-ff14-4300-800d-c3251aba3a96): created successfully Sep 09 18:22:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b92372-8bff-4bc0-8e73-9aaf1d692d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Flow 'volume_create_manager' (83a3c51f-75cf-4991-baf6-b345dee89934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:01 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-56c256af-b7ce-41dc-a40b-82d811c8af85 tempest-VolumesGetTest-107668911 None] Created volume successfully. Sep 09 18:22:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1d9ec244-6343-4351-9115-3e50002224f3 tempest-VolumesGetTest-107668911 None] Acquiring lock "cinder-a9e40a01-ff14-4300-800d-c3251aba3a96-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1d9ec244-6343-4351-9115-3e50002224f3 tempest-VolumesGetTest-107668911 None] Lock "cinder-a9e40a01-ff14-4300-800d-c3251aba3a96-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1d9ec244-6343-4351-9115-3e50002224f3 tempest-VolumesGetTest-107668911 None] Acquiring lock "cinder-quobyte-a9e40a01-ff14-4300-800d-c3251aba3a96" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1d9ec244-6343-4351-9115-3e50002224f3 tempest-VolumesGetTest-107668911 None] Lock "cinder-quobyte-a9e40a01-ff14-4300-800d-c3251aba3a96" acquired by "delete_volume" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:03 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cb8362-08e0-4168-8dc9-b2c79df5ad64]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1d9ec244-6343-4351-9115-3e50002224f3 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a9e40a01-ff14-4300-800d-c3251aba3a96 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:03 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a9e40a01-ff14-4300-800d-c3251aba3a96 Sep 09 18:22:03 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:03 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1d9ec244-6343-4351-9115-3e50002224f3 tempest-VolumesGetTest-107668911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a9e40a01-ff14-4300-800d-c3251aba3a96" returned: 0 in 0.451s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1d9ec244-6343-4351-9115-3e50002224f3 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a9e40a01-ff14-4300-800d-c3251aba3a96 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:03 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a9e40a01-ff14-4300-800d-c3251aba3a96 Sep 09 18:22:03 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:04 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1d9ec244-6343-4351-9115-3e50002224f3 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a9e40a01-ff14-4300-800d-c3251aba3a96" returned: 0 in 0.321s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1d9ec244-6343-4351-9115-3e50002224f3 tempest-VolumesGetTest-107668911 None] Lock "cinder-quobyte-a9e40a01-ff14-4300-800d-c3251aba3a96" released by "delete_volume" :: held 0.833s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:04 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-1d9ec244-6343-4351-9115-3e50002224f3 tempest-VolumesGetTest-107668911 None] Created reservations ['09a7c813-84af-4848-8d6a-865c73c0533f', '5036578d-0502-4cdb-9e57-b0de37bbded8', 'a7693ffb-0ee8-4b65-879a-43ab36754479', 'f53cf5e6-d414-4f0e-9b9f-46f4f721c0a9'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:22:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1d9ec244-6343-4351-9115-3e50002224f3 tempest-VolumesGetTest-107668911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1d9ec244-6343-4351-9115-3e50002224f3 tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:04 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1d9ec244-6343-4351-9115-3e50002224f3 tempest-VolumesGetTest-107668911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:04 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1d9ec244-6343-4351-9115-3e50002224f3 tempest-VolumesGetTest-107668911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1d9ec244-6343-4351-9115-3e50002224f3 tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1d9ec244-6343-4351-9115-3e50002224f3 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:04 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:22:04 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c3f0304b-1de7-4c21-93e3-95ad69e13162 tempest-VolumesGetTest-107668911 None] Acquiring lock "cinder-3ef94710-5bb4-4ca9-848f-4c45da527ccc-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c3f0304b-1de7-4c21-93e3-95ad69e13162 tempest-VolumesGetTest-107668911 None] Lock "cinder-3ef94710-5bb4-4ca9-848f-4c45da527ccc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c3f0304b-1de7-4c21-93e3-95ad69e13162 tempest-VolumesGetTest-107668911 None] Acquiring lock "cinder-quobyte-3ef94710-5bb4-4ca9-848f-4c45da527ccc" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c3f0304b-1de7-4c21-93e3-95ad69e13162 tempest-VolumesGetTest-107668911 None] Lock "cinder-quobyte-3ef94710-5bb4-4ca9-848f-4c45da527ccc" acquired by "delete_volume" :: waited 0.025s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:04 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:04 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d4ed59-d910-4748-bfc3-a9133cb48b89]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c3f0304b-1de7-4c21-93e3-95ad69e13162 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ef94710-5bb4-4ca9-848f-4c45da527ccc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1d9ec244-6343-4351-9115-3e50002224f3 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.369s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:04 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-1d9ec244-6343-4351-9115-3e50002224f3 tempest-VolumesGetTest-107668911 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:22:04 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-1d9ec244-6343-4351-9115-3e50002224f3 tempest-VolumesGetTest-107668911 None] Deleted volume successfully. Sep 09 18:22:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1d9ec244-6343-4351-9115-3e50002224f3 tempest-VolumesGetTest-107668911 None] Lock "cinder-a9e40a01-ff14-4300-800d-c3251aba3a96-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:04 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ef94710-5bb4-4ca9-848f-4c45da527ccc Sep 09 18:22:04 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=131,cinder:UPDATE=166,cinder:INSERT=46,cinder:DELETE=12 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:22:05 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Flow 'volume_create_manager' (6c558540-8069-4630-aa80-725080a9fec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc93c07-4e5f-49a1-a642-2e5ddb19bb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=125,cinder:UPDATE=160,cinder:INSERT=34,cinder:DELETE=13 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c3f0304b-1de7-4c21-93e3-95ad69e13162 tempest-VolumesGetTest-107668911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ef94710-5bb4-4ca9-848f-4c45da527ccc" returned: 0 in 0.612s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c3f0304b-1de7-4c21-93e3-95ad69e13162 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ef94710-5bb4-4ca9-848f-4c45da527ccc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc93c07-4e5f-49a1-a642-2e5ddb19bb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-621224703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a304f5fa-432b-4d43-92d8-0035531c3edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe94102d52942ecbf6fa85cd285071a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:05Z,use_quota=True,user_id='b110201681014606a4b47edd7088136c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7291eb1e-b985-40f2-9806-0c3378e9794b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7291eb1e-b985-40f2-9806-0c3378e9794b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:05 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ef94710-5bb4-4ca9-848f-4c45da527ccc Sep 09 18:22:05 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a1cf9e-e5ac-41c0-ad78-0b1d059920ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a1cf9e-e5ac-41c0-ad78-0b1d059920ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a304f5fa-432b-4d43-92d8-0035531c3edb', 'volume_name': 'volume-a304f5fa-432b-4d43-92d8-0035531c3edb', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b93d50-c8e2-46aa-9529-8a4c5209271b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14b93d50-c8e2-46aa-9529-8a4c5209271b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21262c3f-2aba-4a3a-870b-18ea4339c7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:05 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Volume a304f5fa-432b-4d43-92d8-0035531c3edb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a304f5fa-432b-4d43-92d8-0035531c3edb', 'volume_size': 1} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-621224703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a304f5fa-432b-4d43-92d8-0035531c3edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe94102d52942ecbf6fa85cd285071a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:05Z,use_quota=True,user_id='b110201681014606a4b47edd7088136c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Creating volume a304f5fa-432b-4d43-92d8-0035531c3edb {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:22:05 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a304f5fa-432b-4d43-92d8-0035531c3edb 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:05 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a304f5fa-432b-4d43-92d8-0035531c3edb 1073741824 Sep 09 18:22:05 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:05 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c3f0304b-1de7-4c21-93e3-95ad69e13162 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ef94710-5bb4-4ca9-848f-4c45da527ccc" returned: 0 in 0.389s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c3f0304b-1de7-4c21-93e3-95ad69e13162 tempest-VolumesGetTest-107668911 None] Lock "cinder-quobyte-3ef94710-5bb4-4ca9-848f-4c45da527ccc" released by "delete_volume" :: held 1.059s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-c3f0304b-1de7-4c21-93e3-95ad69e13162 tempest-VolumesGetTest-107668911 None] Created reservations ['2cbb4ba5-b305-45bc-a5d4-2da63c8564af', '2c516316-1369-4fd1-9a38-cb3171fb9b19', 'fdff2d9b-7615-42ff-9334-74cd7c850612', 'df7145ac-61ad-468d-9594-584be7a51faa'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c3f0304b-1de7-4c21-93e3-95ad69e13162 tempest-VolumesGetTest-107668911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c3f0304b-1de7-4c21-93e3-95ad69e13162 tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c3f0304b-1de7-4c21-93e3-95ad69e13162 tempest-VolumesGetTest-107668911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c3f0304b-1de7-4c21-93e3-95ad69e13162 tempest-VolumesGetTest-107668911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c3f0304b-1de7-4c21-93e3-95ad69e13162 tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c3f0304b-1de7-4c21-93e3-95ad69e13162 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:05 devstack sudo[99617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:22:05 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:05 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a304f5fa-432b-4d43-92d8-0035531c3edb 1073741824" returned: 0 in 0.598s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a304f5fa-432b-4d43-92d8-0035531c3edb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:06 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a304f5fa-432b-4d43-92d8-0035531c3edb Sep 09 18:22:06 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:06 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c3f0304b-1de7-4c21-93e3-95ad69e13162 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.363s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-c3f0304b-1de7-4c21-93e3-95ad69e13162 tempest-VolumesGetTest-107668911 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:22:06 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-c3f0304b-1de7-4c21-93e3-95ad69e13162 tempest-VolumesGetTest-107668911 None] Deleted volume successfully. Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c3f0304b-1de7-4c21-93e3-95ad69e13162 tempest-VolumesGetTest-107668911 None] Lock "cinder-3ef94710-5bb4-4ca9-848f-4c45da527ccc-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:06 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a304f5fa-432b-4d43-92d8-0035531c3edb" returned: 0 in 0.365s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21262c3f-2aba-4a3a-870b-18ea4339c7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a304f5fa-432b-4d43-92d8-0035531c3edb', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe068a9-b505-4dc8-854c-59ef94139b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:06 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Volume volume-a304f5fa-432b-4d43-92d8-0035531c3edb (a304f5fa-432b-4d43-92d8-0035531c3edb): created successfully Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fe068a9-b505-4dc8-854c-59ef94139b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Flow 'volume_create_manager' (6c558540-8069-4630-aa80-725080a9fec1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:06 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-1658dc60-a7d5-4a02-aadf-1731c7de63a7 tempest-VolumeQuotasAdminTestJSON-375725298 None] Created volume successfully. Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Flow 'volume_create_manager' (82c38f5e-3f77-48a1-a1d0-e5fdbf84e5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342f39bc-7214-4dbd-b7b5-18b76fb9c19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (342f39bc-7214-4dbd-b7b5-18b76fb9c19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1055340936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fdf509487164f8eb37b04b66899278a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:07Z,use_quota=True,user_id='2e2c4409cab54322b72869f8147d61cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (befb69db-c65f-4a5e-8092-a7f7ee445d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (befb69db-c65f-4a5e-8092-a7f7ee445d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca2bbcea-753c-4351-b7eb-38cb2177bf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca2bbcea-753c-4351-b7eb-38cb2177bf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6', 'volume_name': 'volume-116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93df8f50-d29a-40fa-8706-12130a178c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93df8f50-d29a-40fa-8706-12130a178c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3503d1c4-4203-4b1a-bc05-7c9fa5a6046c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:06 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Volume 116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6', 'volume_size': 1} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1055340936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fdf509487164f8eb37b04b66899278a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:07Z,use_quota=True,user_id='2e2c4409cab54322b72869f8147d61cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Creating volume 116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:22:06 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:22:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:06 devstack sudo[99623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6 1073741824 Sep 09 18:22:06 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:07 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:22:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Flow 'volume_create_manager' (9c04eeb2-859d-4038-8402-b66e16103d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c059a3c-41d5-422f-ab4b-8e6a2516414a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c059a3c-41d5-422f-ab4b-8e6a2516414a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2133510628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79bccd59-4d6e-4835-8269-c1f188841e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d3ce03c12284a488de533e75a8321b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:07Z,use_quota=True,user_id='3dd44c266c384085b5d209600e46aa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ae11a1-9d6b-4e08-98b1-528bfd37d142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ae11a1-9d6b-4e08-98b1-528bfd37d142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0b7527-1048-47e2-9a35-03eee3ce481a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e0b7527-1048-47e2-9a35-03eee3ce481a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79bccd59-4d6e-4835-8269-c1f188841e59', 'volume_name': 'volume-79bccd59-4d6e-4835-8269-c1f188841e59', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c8e604-010a-4e12-81d4-37cbc130b65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c8e604-010a-4e12-81d4-37cbc130b65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f72495-491b-420f-bd2d-5d48d5216c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:07 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Volume 79bccd59-4d6e-4835-8269-c1f188841e59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79bccd59-4d6e-4835-8269-c1f188841e59', 'volume_size': 1} Sep 09 18:22:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:07 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4ae4384c-4771-475a-9c4b-7a8b1eecb20f tempest-VolumeQuotasAdminTestJSON-375725298 None] Acquiring lock "cinder-a304f5fa-432b-4d43-92d8-0035531c3edb-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:07 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4ae4384c-4771-475a-9c4b-7a8b1eecb20f tempest-VolumeQuotasAdminTestJSON-375725298 None] Lock "cinder-a304f5fa-432b-4d43-92d8-0035531c3edb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:07 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4ae4384c-4771-475a-9c4b-7a8b1eecb20f tempest-VolumeQuotasAdminTestJSON-375725298 None] Acquiring lock "cinder-quobyte-a304f5fa-432b-4d43-92d8-0035531c3edb" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:07 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6 1073741824" returned: 0 in 0.752s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:07 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4ae4384c-4771-475a-9c4b-7a8b1eecb20f tempest-VolumeQuotasAdminTestJSON-375725298 None] Lock "cinder-quobyte-a304f5fa-432b-4d43-92d8-0035531c3edb" acquired by "delete_volume" :: waited 0.020s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:07 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8578debe-eafc-4fa7-8e27-8c47cbf66fb1]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4ae4384c-4771-475a-9c4b-7a8b1eecb20f tempest-VolumeQuotasAdminTestJSON-375725298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a304f5fa-432b-4d43-92d8-0035531c3edb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:07 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6 Sep 09 18:22:07 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:07 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a304f5fa-432b-4d43-92d8-0035531c3edb Sep 09 18:22:07 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:08 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6" returned: 0 in 0.274s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.427s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2133510628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79bccd59-4d6e-4835-8269-c1f188841e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d3ce03c12284a488de533e75a8321b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:07Z,use_quota=True,user_id='3dd44c266c384085b5d209600e46aa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Creating volume 79bccd59-4d6e-4835-8269-c1f188841e59 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:22:08 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:08 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59 1073741824 Sep 09 18:22:08 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3503d1c4-4203-4b1a-bc05-7c9fa5a6046c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd5d7c7-fab4-4b26-91c2-5a28c76a6eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:08 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Volume volume-116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6 (116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6): created successfully Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd5d7c7-fab4-4b26-91c2-5a28c76a6eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Flow 'volume_create_manager' (82c38f5e-3f77-48a1-a1d0-e5fdbf84e5a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:08 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-8256df5e-afbc-46db-b24a-0aab94337c9f tempest-VolumesNegativeTest-1010116564 None] Created volume successfully. Sep 09 18:22:08 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4ae4384c-4771-475a-9c4b-7a8b1eecb20f tempest-VolumeQuotasAdminTestJSON-375725298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a304f5fa-432b-4d43-92d8-0035531c3edb" returned: 0 in 0.453s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4ae4384c-4771-475a-9c4b-7a8b1eecb20f tempest-VolumeQuotasAdminTestJSON-375725298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a304f5fa-432b-4d43-92d8-0035531c3edb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:08 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a304f5fa-432b-4d43-92d8-0035531c3edb Sep 09 18:22:08 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:08 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4ae4384c-4771-475a-9c4b-7a8b1eecb20f tempest-VolumeQuotasAdminTestJSON-375725298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a304f5fa-432b-4d43-92d8-0035531c3edb" returned: 0 in 0.318s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4ae4384c-4771-475a-9c4b-7a8b1eecb20f tempest-VolumeQuotasAdminTestJSON-375725298 None] Lock "cinder-quobyte-a304f5fa-432b-4d43-92d8-0035531c3edb" released by "delete_volume" :: held 0.824s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-4ae4384c-4771-475a-9c4b-7a8b1eecb20f tempest-VolumeQuotasAdminTestJSON-375725298 None] Created reservations ['cb9d8e64-ce13-49f9-b19f-1e81313ed4d4', 'fad704af-d2c8-4ed9-9aaa-a6b27c21985c', 'f4ee67e2-5cb7-47f8-a087-a53377050a35', '18c0db90-7d48-4577-934a-7aca81c2ac59'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:22:08 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59 1073741824" returned: 0 in 0.555s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:08 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59 Sep 09 18:22:08 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4ae4384c-4771-475a-9c4b-7a8b1eecb20f tempest-VolumeQuotasAdminTestJSON-375725298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4ae4384c-4771-475a-9c4b-7a8b1eecb20f tempest-VolumeQuotasAdminTestJSON-375725298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4ae4384c-4771-475a-9c4b-7a8b1eecb20f tempest-VolumeQuotasAdminTestJSON-375725298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4ae4384c-4771-475a-9c4b-7a8b1eecb20f tempest-VolumeQuotasAdminTestJSON-375725298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4ae4384c-4771-475a-9c4b-7a8b1eecb20f tempest-VolumeQuotasAdminTestJSON-375725298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4ae4384c-4771-475a-9c4b-7a8b1eecb20f tempest-VolumeQuotasAdminTestJSON-375725298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:08 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:22:08 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:09 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59" returned: 0 in 0.391s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77f72495-491b-420f-bd2d-5d48d5216c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79bccd59-4d6e-4835-8269-c1f188841e59', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a2640e-e94d-4856-967d-b7e4d69aa01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:09 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Volume volume-79bccd59-4d6e-4835-8269-c1f188841e59 (79bccd59-4d6e-4835-8269-c1f188841e59): created successfully Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a2640e-e94d-4856-967d-b7e4d69aa01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Flow 'volume_create_manager' (9c04eeb2-859d-4038-8402-b66e16103d21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:09 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d9f97beb-21d5-46d1-82bb-d57aa8493e8e tempest-VolumesGetTest-107668911 None] Created volume successfully. Sep 09 18:22:09 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4ae4384c-4771-475a-9c4b-7a8b1eecb20f tempest-VolumeQuotasAdminTestJSON-375725298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.552s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-4ae4384c-4771-475a-9c4b-7a8b1eecb20f tempest-VolumeQuotasAdminTestJSON-375725298 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:22:09 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-4ae4384c-4771-475a-9c4b-7a8b1eecb20f tempest-VolumeQuotasAdminTestJSON-375725298 None] Deleted volume successfully. Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4ae4384c-4771-475a-9c4b-7a8b1eecb20f tempest-VolumeQuotasAdminTestJSON-375725298 None] Lock "cinder-a304f5fa-432b-4d43-92d8-0035531c3edb-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Flow 'volume_create_manager' (c1d7a901-8ac3-41a2-b025-65788d5a73cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53299f1e-ffd8-4197-961b-fa54ae04d78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53299f1e-ffd8-4197-961b-fa54ae04d78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1011314545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf64f95-960e-4915-ab40-ea0bf725b541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe94102d52942ecbf6fa85cd285071a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:10Z,use_quota=True,user_id='b110201681014606a4b47edd7088136c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c41207-23b3-440f-85cc-e486b68a1169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c41207-23b3-440f-85cc-e486b68a1169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc7149b-f3c5-45cf-8487-e521a92afd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc7149b-f3c5-45cf-8487-e521a92afd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cf64f95-960e-4915-ab40-ea0bf725b541', 'volume_name': 'volume-4cf64f95-960e-4915-ab40-ea0bf725b541', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af07e588-2e6a-4d5d-afb5-84f6ca78da49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af07e588-2e6a-4d5d-afb5-84f6ca78da49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f8d4f1-2373-4239-8b36-95187f5ebaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:09 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Volume 4cf64f95-960e-4915-ab40-ea0bf725b541: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cf64f95-960e-4915-ab40-ea0bf725b541', 'volume_size': 1} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1011314545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf64f95-960e-4915-ab40-ea0bf725b541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebe94102d52942ecbf6fa85cd285071a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:10Z,use_quota=True,user_id='b110201681014606a4b47edd7088136c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Creating volume 4cf64f95-960e-4915-ab40-ea0bf725b541 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:22:09 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:22:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4cf64f95-960e-4915-ab40-ea0bf725b541 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:09 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4cf64f95-960e-4915-ab40-ea0bf725b541 1073741824 Sep 09 18:22:09 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:10 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:22:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Flow 'volume_create_manager' (f9ea7633-0e07-43ca-81ab-dc8475c3738b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a56563f-8843-4ded-85b9-ec75c6d6ec01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a56563f-8843-4ded-85b9-ec75c6d6ec01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-409092530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96072c9e-bc74-4c6a-abd6-c4152f3ddfe8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7d3ce03c12284a488de533e75a8321b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=79bccd59-4d6e-4835-8269-c1f188841e59,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:10Z,use_quota=True,user_id='3dd44c266c384085b5d209600e46aa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec23e66-0c41-4447-a3d9-ff3619a864ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec23e66-0c41-4447-a3d9-ff3619a864ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46129bb-d690-4625-a9c9-ec38b069cb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46129bb-d690-4625-a9c9-ec38b069cb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '96072c9e-bc74-4c6a-abd6-c4152f3ddfe8', 'volume_name': 'volume-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8', 'volume_size': 1, 'source_volid': '79bccd59-4d6e-4835-8269-c1f188841e59', 'source_volstatus': 'available'}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (072b7887-3fa8-4b14-9659-7176c967fb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (072b7887-3fa8-4b14-9659-7176c967fb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667671d2-ac10-4c1d-938e-e21942ecb0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:10 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Volume 96072c9e-bc74-4c6a-abd6-c4152f3ddfe8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8', 'volume_size': 1, 'source_volid': '79bccd59-4d6e-4835-8269-c1f188841e59', 'source_volstatus': 'available'} Sep 09 18:22:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:10 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4cf64f95-960e-4915-ab40-ea0bf725b541 1073741824" returned: 0 in 0.767s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4cf64f95-960e-4915-ab40-ea0bf725b541 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:10 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4cf64f95-960e-4915-ab40-ea0bf725b541 Sep 09 18:22:10 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:10 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4cf64f95-960e-4915-ab40-ea0bf725b541" returned: 0 in 0.320s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:22:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.399s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:10 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Cloning volume 79bccd59-4d6e-4835-8269-c1f188841e59 to volume 96072c9e-bc74-4c6a-abd6-c4152f3ddfe8 Sep 09 18:22:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f8d4f1-2373-4239-8b36-95187f5ebaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cf64f95-960e-4915-ab40-ea0bf725b541', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d35e4257-f3e8-4fd9-80f2-b167690c646b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:10 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Volume volume-4cf64f95-960e-4915-ab40-ea0bf725b541 (4cf64f95-960e-4915-ab40-ea0bf725b541): created successfully Sep 09 18:22:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d35e4257-f3e8-4fd9-80f2-b167690c646b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Flow 'volume_create_manager' (c1d7a901-8ac3-41a2-b025-65788d5a73cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Creating offline snapshot 185fd896-93fa-418f-a16e-cb44921f583d of volume 79bccd59-4d6e-4835-8269-c1f188841e59 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:22:11 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-56477ab2-eade-4b7d-a398-e888514e6b5b tempest-VolumeQuotasAdminTestJSON-375725298 None] Created volume successfully. Sep 09 18:22:11 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4050b28b-4b70-4a20-8942-82391662a745]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:11 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59 Sep 09 18:22:11 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:11 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59" returned: 0 in 0.463s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:11 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d 1G Sep 09 18:22:11 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:12 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d 1G" returned: 0 in 0.609s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79bccd59-4d6e-4835-8269-c1f188841e59 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:12 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79bccd59-4d6e-4835-8269-c1f188841e59 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d Sep 09 18:22:12 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:12 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79bccd59-4d6e-4835-8269-c1f188841e59 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d" returned: 0 in 0.512s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:12 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d is being set with open permissions: ugo+rw Sep 09 18:22:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:12 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d Sep 09 18:22:12 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:12 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-4793a7c1-add7-45f0-bfe5-a463764d21d9 tempest-VolumeQuotasAdminTestJSON-1182828507 None] Transfer volume completed successfully. Sep 09 18:22:13 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d" returned: 0 in 0.412s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:13 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.info Sep 09 18:22:13 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:13 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.info" returned: 0 in 0.502s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:13 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.info is being set with open permissions: ugo+rw Sep 09 18:22:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:13 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.info Sep 09 18:22:13 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:13 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-60ef404f-4a66-4879-b5fc-76ef558dfea7 tempest-VolumeQuotasAdminTestJSON-1122837723 None] Acquiring lock "cinder-4cf64f95-960e-4915-ab40-ea0bf725b541-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:13 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-60ef404f-4a66-4879-b5fc-76ef558dfea7 tempest-VolumeQuotasAdminTestJSON-1122837723 None] Lock "cinder-4cf64f95-960e-4915-ab40-ea0bf725b541-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:13 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-60ef404f-4a66-4879-b5fc-76ef558dfea7 tempest-VolumeQuotasAdminTestJSON-1122837723 None] Acquiring lock "cinder-quobyte-4cf64f95-960e-4915-ab40-ea0bf725b541" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:13 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-60ef404f-4a66-4879-b5fc-76ef558dfea7 tempest-VolumeQuotasAdminTestJSON-1122837723 None] Lock "cinder-quobyte-4cf64f95-960e-4915-ab40-ea0bf725b541" acquired by "delete_volume" :: waited 0.029s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:13 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c142b7-fb6e-4494-9b48-202e03b5b4c6]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-60ef404f-4a66-4879-b5fc-76ef558dfea7 tempest-VolumeQuotasAdminTestJSON-1122837723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4cf64f95-960e-4915-ab40-ea0bf725b541 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:14 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.info" returned: 0 in 0.431s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:14 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Acquiring lock "cinder-quobyte-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8" by "_copy_volume_from_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:14 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Lock "cinder-quobyte-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] snapshot: 185fd896-93fa-418f-a16e-cb44921f583d, volume: 96072c9e-bc74-4c6a-abd6-c4152f3ddfe8, {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 18:22:14 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4cf64f95-960e-4915-ab40-ea0bf725b541 Sep 09 18:22:14 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:14 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2e1444-01ea-462b-b1da-7c1196ffdce9]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:14 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d Sep 09 18:22:14 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:14 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-60ef404f-4a66-4879-b5fc-76ef558dfea7 tempest-VolumeQuotasAdminTestJSON-1122837723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4cf64f95-960e-4915-ab40-ea0bf725b541" returned: 0 in 0.474s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-60ef404f-4a66-4879-b5fc-76ef558dfea7 tempest-VolumeQuotasAdminTestJSON-1122837723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4cf64f95-960e-4915-ab40-ea0bf725b541 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:14 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4cf64f95-960e-4915-ab40-ea0bf725b541 Sep 09 18:22:14 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:14 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d" returned: 0 in 0.509s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79bccd59-4d6e-4835-8269-c1f188841e59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:22:14 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[124fca2b-eb9b-4891-8c6e-c0c487928df1]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:14 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59 Sep 09 18:22:14 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:14 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-60ef404f-4a66-4879-b5fc-76ef558dfea7 tempest-VolumeQuotasAdminTestJSON-1122837723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4cf64f95-960e-4915-ab40-ea0bf725b541" returned: 0 in 0.414s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:14 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-60ef404f-4a66-4879-b5fc-76ef558dfea7 tempest-VolumeQuotasAdminTestJSON-1122837723 None] Lock "cinder-quobyte-4cf64f95-960e-4915-ab40-ea0bf725b541" released by "delete_volume" :: held 1.000s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:14 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-60ef404f-4a66-4879-b5fc-76ef558dfea7 tempest-VolumeQuotasAdminTestJSON-1122837723 None] Created reservations ['56a0530c-5664-4c10-89a7-fb65b60045d8', '8e32510f-60ea-466c-8ad6-7a8e446b12d1', '08ed9200-13ae-43b8-8eaf-a85cfe119e8d', '188d98ff-0040-45eb-add1-0a9fb65dc859'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:22:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-60ef404f-4a66-4879-b5fc-76ef558dfea7 tempest-VolumeQuotasAdminTestJSON-1122837723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-60ef404f-4a66-4879-b5fc-76ef558dfea7 tempest-VolumeQuotasAdminTestJSON-1122837723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:15 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-60ef404f-4a66-4879-b5fc-76ef558dfea7 tempest-VolumeQuotasAdminTestJSON-1122837723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:15 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-60ef404f-4a66-4879-b5fc-76ef558dfea7 tempest-VolumeQuotasAdminTestJSON-1122837723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-60ef404f-4a66-4879-b5fc-76ef558dfea7 tempest-VolumeQuotasAdminTestJSON-1122837723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-60ef404f-4a66-4879-b5fc-76ef558dfea7 tempest-VolumeQuotasAdminTestJSON-1122837723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:15 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:22:15 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:15 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59" returned: 0 in 0.496s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:15 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59 {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 18:22:15 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Creating direct copy from snapshot {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 18:22:15 devstack cinder-volume[87639]: DEBUG cinder.utils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Path /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8 not found in is_blk_device check {{(pid=87639) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 18:22:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:15 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8 Sep 09 18:22:15 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:15 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-60ef404f-4a66-4879-b5fc-76ef558dfea7 tempest-VolumeQuotasAdminTestJSON-1122837723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.294s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:15 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-60ef404f-4a66-4879-b5fc-76ef558dfea7 tempest-VolumeQuotasAdminTestJSON-1122837723 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:22:15 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-60ef404f-4a66-4879-b5fc-76ef558dfea7 tempest-VolumeQuotasAdminTestJSON-1122837723 None] Deleted volume successfully. Sep 09 18:22:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-60ef404f-4a66-4879-b5fc-76ef558dfea7 tempest-VolumeQuotasAdminTestJSON-1122837723 None] Lock "cinder-4cf64f95-960e-4915-ab40-ea0bf725b541-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:23 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8" returned: 0 in 7.967s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:23 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Image conversion details: src /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59, size 1024.00 MB, duration 7.97 sec, destination /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8 {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:22:23 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Converted 1024.00 MB image at 128.49 MB/s Sep 09 18:22:23 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8 is being set with open permissions: ugo+rw Sep 09 18:22:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:23 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8 Sep 09 18:22:23 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:23 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8" returned: 0 in 0.377s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Lock "cinder-quobyte-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8" released by "_copy_volume_from_snapshot" :: held 9.446s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Acquiring lock "cinder-quobyte-185fd896-93fa-418f-a16e-cb44921f583d" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Lock "cinder-quobyte-185fd896-93fa-418f-a16e-cb44921f583d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Deleting offline snapshot 185fd896-93fa-418f-a16e-cb44921f583d of volume 79bccd59-4d6e-4835-8269-c1f188841e59 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:22:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] snapshot_file for this snap is: volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:22:23 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb56930-ca11-41a0-9989-22b5b20136ce]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:23 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d Sep 09 18:22:23 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:24 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d" returned: 0 in 0.540s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79bccd59-4d6e-4835-8269-c1f188841e59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:22:24 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[edea903a-5ddc-43e3-8368-da1961ee35a8]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:24 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59 Sep 09 18:22:24 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:24 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:22:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Flow 'volume_create_manager' (e928c395-7036-414f-8b5a-ef46ca7f642b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3808dc38-f6b4-48bc-8946-842d63dea562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3808dc38-f6b4-48bc-8946-842d63dea562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1271831958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e381b9-b926-44a8-9a62-a934f5f711d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35adbcf27dbd43528ef29daec1cde513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:25Z,use_quota=True,user_id='681cc1f52f6e4e86a109218829d0e9d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3095c075-86d9-465a-af29-278217346269),volume_type_id=3095c075-86d9-465a-af29-278217346269)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa0aaef-de36-4705-9a19-1a3f6c3b6201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa0aaef-de36-4705-9a19-1a3f6c3b6201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2966764b-31d1-4129-989b-186b1d3f96bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2966764b-31d1-4129-989b-186b1d3f96bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42e381b9-b926-44a8-9a62-a934f5f711d8', 'volume_name': 'volume-42e381b9-b926-44a8-9a62-a934f5f711d8', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d938009d-1202-4353-9034-2f861a1c2a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d938009d-1202-4353-9034-2f861a1c2a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1121124-4fa7-4bab-9fe6-d2bb06346fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:25 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Volume 42e381b9-b926-44a8-9a62-a934f5f711d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42e381b9-b926-44a8-9a62-a934f5f711d8', 'volume_size': 1} Sep 09 18:22:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:25 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59" returned: 0 in 1.006s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:25 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d Sep 09 18:22:25 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:25 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:22:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Flow 'volume_create_manager' (a085a520-b0a4-43aa-be20-6255159a9dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4fc778c-63e2-413d-a5f1-f1e64ace26e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4fc778c-63e2-413d-a5f1-f1e64ace26e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1237393728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e172a0-53cb-4e1c-8442-5da62b913e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35adbcf27dbd43528ef29daec1cde513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:25Z,use_quota=True,user_id='681cc1f52f6e4e86a109218829d0e9d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f25b32c8-837e-475a-8dbd-958c775a7956),volume_type_id=f25b32c8-837e-475a-8dbd-958c775a7956)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e0915c-176b-49d9-8b6b-1cf27ad67e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e0915c-176b-49d9-8b6b-1cf27ad67e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35427cc5-6355-46a7-9520-2e309c287215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35427cc5-6355-46a7-9520-2e309c287215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5e172a0-53cb-4e1c-8442-5da62b913e38', 'volume_name': 'volume-b5e172a0-53cb-4e1c-8442-5da62b913e38', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a599bf7-cda3-4cca-8254-c7113771c2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a599bf7-cda3-4cca-8254-c7113771c2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259423f7-cac8-4a49-8574-ba1a74a44c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:25 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Volume b5e172a0-53cb-4e1c-8442-5da62b913e38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5e172a0-53cb-4e1c-8442-5da62b913e38', 'volume_size': 1} Sep 09 18:22:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:25 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d" returned: 0 in 0.519s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:25 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d Sep 09 18:22:25 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:26 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59.185fd896-93fa-418f-a16e-cb44921f583d" returned: 0 in 0.412s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:26 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Lock "cinder-quobyte-185fd896-93fa-418f-a16e-cb44921f583d" released by "_delete_snapshot" :: held 2.634s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.382s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.225s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1271831958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e381b9-b926-44a8-9a62-a934f5f711d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35adbcf27dbd43528ef29daec1cde513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:25Z,use_quota=True,user_id='681cc1f52f6e4e86a109218829d0e9d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3095c075-86d9-465a-af29-278217346269),volume_type_id=3095c075-86d9-465a-af29-278217346269)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:22:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Creating volume 42e381b9-b926-44a8-9a62-a934f5f711d8 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:22:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:22:26 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:22:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-42e381b9-b926-44a8-9a62-a934f5f711d8 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:26 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-42e381b9-b926-44a8-9a62-a934f5f711d8 1073741824 Sep 09 18:22:26 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667671d2-ac10-4c1d-938e-e21942ecb0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8', 'volume_size': 1, 'source_volid': '79bccd59-4d6e-4835-8269-c1f188841e59', 'source_volstatus': 'available'}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacc2ca9-8082-4ad6-b709-287f164c60c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:26 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Volume volume-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8 (96072c9e-bc74-4c6a-abd6-c4152f3ddfe8): created successfully Sep 09 18:22:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacc2ca9-8082-4ad6-b709-287f164c60c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Flow 'volume_create_manager' (f9ea7633-0e07-43ca-81ab-dc8475c3738b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:26 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-fabd263e-f989-47b6-9780-eab35426ebc4 tempest-VolumesGetTest-107668911 None] Created volume successfully. Sep 09 18:22:26 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:22:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Flow 'volume_create_manager' (179386b0-8b20-4da4-80b8-dfa8940f0139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f7324f5-2cfa-4303-8de1-18c505a84525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f7324f5-2cfa-4303-8de1-18c505a84525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-890347831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa0ce66-642c-4f68-94cd-736e34ef801e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35adbcf27dbd43528ef29daec1cde513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:27Z,use_quota=True,user_id='681cc1f52f6e4e86a109218829d0e9d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5101ad-f55f-4965-bca2-b61c7cd50aa7),volume_type_id=9a5101ad-f55f-4965-bca2-b61c7cd50aa7)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7d8bc0-e2ab-4643-b29f-d79caea46bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7d8bc0-e2ab-4643-b29f-d79caea46bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee53d7e5-6052-42ab-8d90-27450f4bfb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG cinder.image.glance [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Creating Keystone auth plugin from conf {{(pid=87639) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 18:22:27 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-42e381b9-b926-44a8-9a62-a934f5f711d8 1073741824" returned: 0 in 0.866s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-42e381b9-b926-44a8-9a62-a934f5f711d8 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:27 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-42e381b9-b926-44a8-9a62-a934f5f711d8 Sep 09 18:22:27 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:27 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee53d7e5-6052-42ab-8d90-27450f4bfb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2aa0ce66-642c-4f68-94cd-736e34ef801e', 'volume_name': 'volume-2aa0ce66-642c-4f68-94cd-736e34ef801e', 'volume_size': 1, 'image_id': '01e36f3e-5a51-4193-821a-35d6dd5d89a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01e36f3e-5a51-4193-821a-35d6dd5d89a5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1486416506', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '35adbcf27dbd43528ef29daec1cde513', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '01e36f3e-5a51-4193-821a-35d6dd5d89a5', 'created_at': datetime.datetime(2026, 9, 9, 16, 22, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 22, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01e36f3e-5a51-4193-821a-35d6dd5d89a5/file', 'properties': {}}, 'image_service': }' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38c6321-6e14-4e46-9f6a-214e595a63a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38c6321-6e14-4e46-9f6a-214e595a63a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37997864-0fdc-4a00-829f-0a62ae39b2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:27 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Volume 2aa0ce66-642c-4f68-94cd-736e34ef801e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2aa0ce66-642c-4f68-94cd-736e34ef801e', 'volume_size': 1, 'image_id': '01e36f3e-5a51-4193-821a-35d6dd5d89a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01e36f3e-5a51-4193-821a-35d6dd5d89a5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1486416506', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '35adbcf27dbd43528ef29daec1cde513', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '01e36f3e-5a51-4193-821a-35d6dd5d89a5', 'created_at': datetime.datetime(2026, 9, 9, 16, 22, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 22, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01e36f3e-5a51-4193-821a-35d6dd5d89a5/file', 'properties': {}}, 'image_service': } Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Trying to clone 2aa0ce66-642c-4f68-94cd-736e34ef801e from image 01e36f3e-5a51-4193-821a-35d6dd5d89a5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/01e36f3e-5a51-4193-821a-35d6dd5d89a5', 'metadata': {}}]). {{(pid=87639) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-42e381b9-b926-44a8-9a62-a934f5f711d8" returned: 0 in 0.475s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.132s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1237393728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e172a0-53cb-4e1c-8442-5da62b913e38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35adbcf27dbd43528ef29daec1cde513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:25Z,use_quota=True,user_id='681cc1f52f6e4e86a109218829d0e9d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f25b32c8-837e-475a-8dbd-958c775a7956),volume_type_id=f25b32c8-837e-475a-8dbd-958c775a7956)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Creating volume b5e172a0-53cb-4e1c-8442-5da62b913e38 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:22:27 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5e172a0-53cb-4e1c-8442-5da62b913e38 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:27 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5e172a0-53cb-4e1c-8442-5da62b913e38 1073741824 Sep 09 18:22:27 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1121124-4fa7-4bab-9fe6-d2bb06346fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42e381b9-b926-44a8-9a62-a934f5f711d8', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d53f5a7-63d8-4559-a927-99937d47c1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:27 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Volume volume-42e381b9-b926-44a8-9a62-a934f5f711d8 (42e381b9-b926-44a8-9a62-a934f5f711d8): created successfully Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d53f5a7-63d8-4559-a927-99937d47c1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:27 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Flow 'volume_create_manager' (e928c395-7036-414f-8b5a-ef46ca7f642b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:27 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d47cc56c-a340-486b-84f4-03302d1e12bd tempest-TestInstancesWithCinderVolumes-1868759752 None] Created volume successfully. Sep 09 18:22:28 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5e172a0-53cb-4e1c-8442-5da62b913e38 1073741824" returned: 0 in 0.771s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5e172a0-53cb-4e1c-8442-5da62b913e38 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:28 devstack sudo[99891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5e172a0-53cb-4e1c-8442-5da62b913e38 Sep 09 18:22:28 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:28 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Flow 'volume_create_manager' (7bc6ced2-6829-4770-9c1e-0fd8fa725fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a969654d-91d0-4c9b-8e0a-b857337aa3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5e172a0-53cb-4e1c-8442-5da62b913e38" returned: 0 in 0.323s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a969654d-91d0-4c9b-8e0a-b857337aa3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1182987345',display_name='tempest-VolumesGetTest-Volume-1148573226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46137052-da61-4e3f-907f-d436b052f565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d3ce03c12284a488de533e75a8321b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:29Z,use_quota=True,user_id='3dd44c266c384085b5d209600e46aa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73918128-ff99-483f-8160-8f8aae407599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73918128-ff99-483f-8160-8f8aae407599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f99351cb-90af-465e-a8d6-c66500da3cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f99351cb-90af-465e-a8d6-c66500da3cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46137052-da61-4e3f-907f-d436b052f565', 'volume_name': 'volume-46137052-da61-4e3f-907f-d436b052f565', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d91a14-d260-4923-b82f-7242f9420726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d91a14-d260-4923-b82f-7242f9420726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf56b62-4611-4594-a603-86a565b614aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:28 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Volume 46137052-da61-4e3f-907f-d436b052f565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46137052-da61-4e3f-907f-d436b052f565', 'volume_size': 1} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1182987345',display_name='tempest-VolumesGetTest-Volume-1148573226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46137052-da61-4e3f-907f-d436b052f565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d3ce03c12284a488de533e75a8321b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:29Z,use_quota=True,user_id='3dd44c266c384085b5d209600e46aa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Creating volume 46137052-da61-4e3f-907f-d436b052f565 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:22:28 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:22:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-46137052-da61-4e3f-907f-d436b052f565 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259423f7-cac8-4a49-8574-ba1a74a44c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5e172a0-53cb-4e1c-8442-5da62b913e38', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b89fd625-8e37-44c9-8926-e6a3ffcd05f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:29 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-46137052-da61-4e3f-907f-d436b052f565 1073741824 Sep 09 18:22:29 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:29 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Volume volume-b5e172a0-53cb-4e1c-8442-5da62b913e38 (b5e172a0-53cb-4e1c-8442-5da62b913e38): created successfully Sep 09 18:22:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b89fd625-8e37-44c9-8926-e6a3ffcd05f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Flow 'volume_create_manager' (a085a520-b0a4-43aa-be20-6255159a9dee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:29 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-caa6b6ee-bed2-403c-a7ae-187bad03ae6b tempest-TestInstancesWithCinderVolumes-1868759752 None] Created volume successfully. Sep 09 18:22:29 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-46137052-da61-4e3f-907f-d436b052f565 1073741824" returned: 0 in 0.562s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-46137052-da61-4e3f-907f-d436b052f565 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:29 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-46137052-da61-4e3f-907f-d436b052f565 Sep 09 18:22:29 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:29 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-46137052-da61-4e3f-907f-d436b052f565" returned: 0 in 0.330s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:22:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf56b62-4611-4594-a603-86a565b614aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46137052-da61-4e3f-907f-d436b052f565', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beecbd0e-9eab-4fb1-8c08-d88b7d64fbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:29 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Volume volume-46137052-da61-4e3f-907f-d436b052f565 (46137052-da61-4e3f-907f-d436b052f565): created successfully Sep 09 18:22:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beecbd0e-9eab-4fb1-8c08-d88b7d64fbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Flow 'volume_create_manager' (7bc6ced2-6829-4770-9c1e-0fd8fa725fa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:30 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-00e90c89-a6d7-4a3c-a501-8f49609012fc tempest-VolumesGetTest-107668911 None] Created volume successfully. Sep 09 18:22:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-cfd89e37-315c-4088-8417-044542a367b0 tempest-VolumesGetTest-107668911 None] Acquiring lock "cinder-46137052-da61-4e3f-907f-d436b052f565-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-cfd89e37-315c-4088-8417-044542a367b0 tempest-VolumesGetTest-107668911 None] Lock "cinder-46137052-da61-4e3f-907f-d436b052f565-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-cfd89e37-315c-4088-8417-044542a367b0 tempest-VolumesGetTest-107668911 None] Acquiring lock "cinder-quobyte-46137052-da61-4e3f-907f-d436b052f565" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-cfd89e37-315c-4088-8417-044542a367b0 tempest-VolumesGetTest-107668911 None] Lock "cinder-quobyte-46137052-da61-4e3f-907f-d436b052f565" acquired by "delete_volume" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:31 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6dad1f-4afd-469a-be83-8149b1173202]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cfd89e37-315c-4088-8417-044542a367b0 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-46137052-da61-4e3f-907f-d436b052f565 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:31 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-46137052-da61-4e3f-907f-d436b052f565 Sep 09 18:22:31 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:31 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cfd89e37-315c-4088-8417-044542a367b0 tempest-VolumesGetTest-107668911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-46137052-da61-4e3f-907f-d436b052f565" returned: 0 in 0.489s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cfd89e37-315c-4088-8417-044542a367b0 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-46137052-da61-4e3f-907f-d436b052f565 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:31 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-46137052-da61-4e3f-907f-d436b052f565 Sep 09 18:22:31 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:32 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cfd89e37-315c-4088-8417-044542a367b0 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-46137052-da61-4e3f-907f-d436b052f565" returned: 0 in 0.303s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-cfd89e37-315c-4088-8417-044542a367b0 tempest-VolumesGetTest-107668911 None] Lock "cinder-quobyte-46137052-da61-4e3f-907f-d436b052f565" released by "delete_volume" :: held 0.856s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-cfd89e37-315c-4088-8417-044542a367b0 tempest-VolumesGetTest-107668911 None] Created reservations ['21f6dbe5-e21b-4000-a67d-f8f8556fbbbe', '05f9fccd-ac0e-4e85-a7a6-792a94dc4418', 'e2306acb-09d6-4e21-9f87-6d20ea38fdec', 'b51311c4-57f8-4972-a4b2-4c065698529e'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cfd89e37-315c-4088-8417-044542a367b0 tempest-VolumesGetTest-107668911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cfd89e37-315c-4088-8417-044542a367b0 tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cfd89e37-315c-4088-8417-044542a367b0 tempest-VolumesGetTest-107668911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cfd89e37-315c-4088-8417-044542a367b0 tempest-VolumesGetTest-107668911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cfd89e37-315c-4088-8417-044542a367b0 tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cfd89e37-315c-4088-8417-044542a367b0 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:32 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:22:32 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Flow 'volume_create_manager' (8cf1f95a-72a0-43c5-9650-2396be5b7301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f585d10c-469c-4e32-888f-20069017130a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bb0bc288-0eae-48af-8a97-0e2652795483 tempest-VolumesGetTest-107668911 None] Acquiring lock "cinder-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f585d10c-469c-4e32-888f-20069017130a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-438593239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabda606-2419-4d81-9c3a-a00cecc15947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce0f080ad404be8b417df4d2ff81790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:32Z,use_quota=True,user_id='fbabb07a79ed40659ba7179e4460b847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eadd230-841d-4e8c-834a-7766822474e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eadd230-841d-4e8c-834a-7766822474e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fdc46f8-3c4a-45d1-b1ce-3c23b7084001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fdc46f8-3c4a-45d1-b1ce-3c23b7084001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fabda606-2419-4d81-9c3a-a00cecc15947', 'volume_name': 'volume-fabda606-2419-4d81-9c3a-a00cecc15947', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0fb49d-1316-4580-8837-87361b07e795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a0fb49d-1316-4580-8837-87361b07e795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b23405d-61fa-4ccf-b245-809174f5d870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:32 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Volume fabda606-2419-4d81-9c3a-a00cecc15947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fabda606-2419-4d81-9c3a-a00cecc15947', 'volume_size': 1} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-438593239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabda606-2419-4d81-9c3a-a00cecc15947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dce0f080ad404be8b417df4d2ff81790',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:32Z,use_quota=True,user_id='fbabb07a79ed40659ba7179e4460b847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Creating volume fabda606-2419-4d81-9c3a-a00cecc15947 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:22:32 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fabda606-2419-4d81-9c3a-a00cecc15947 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bb0bc288-0eae-48af-8a97-0e2652795483 tempest-VolumesGetTest-107668911 None] Lock "cinder-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:32 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fabda606-2419-4d81-9c3a-a00cecc15947 1073741824 Sep 09 18:22:32 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:32 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bb0bc288-0eae-48af-8a97-0e2652795483 tempest-VolumesGetTest-107668911 None] Acquiring lock "cinder-quobyte-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cfd89e37-315c-4088-8417-044542a367b0 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.364s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cfd89e37-315c-4088-8417-044542a367b0 tempest-VolumesGetTest-107668911 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:22:32 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-cfd89e37-315c-4088-8417-044542a367b0 tempest-VolumesGetTest-107668911 None] Deleted volume successfully. Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bb0bc288-0eae-48af-8a97-0e2652795483 tempest-VolumesGetTest-107668911 None] Lock "cinder-quobyte-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8" acquired by "delete_volume" :: waited 0.031s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[73341ed1-ff37-4f37-ba33-3d3d0584dc81]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bb0bc288-0eae-48af-8a97-0e2652795483 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-cfd89e37-315c-4088-8417-044542a367b0 tempest-VolumesGetTest-107668911 None] Lock "cinder-46137052-da61-4e3f-907f-d436b052f565-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_01e36f3e-5a51-4193-821a-35d6dd5d89a5_q6xbnna5devstack@QuobyteHD, size 20.69 MB, duration 5.11 sec {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 18:22:32 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Image download 20.69 MB at 4.05 MB/s Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15642bb-68f3-4f4d-beee-8f4bd5075d98]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_01e36f3e-5a51-4193-821a-35d6dd5d89a5_q6xbnna5devstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:32 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8 Sep 09 18:22:32 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:33 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_01e36f3e-5a51-4193-821a-35d6dd5d89a5_q6xbnna5devstack@QuobyteHD Sep 09 18:22:33 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:33 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fabda606-2419-4d81-9c3a-a00cecc15947 1073741824" returned: 0 in 0.522s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fabda606-2419-4d81-9c3a-a00cecc15947 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:33 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bb0bc288-0eae-48af-8a97-0e2652795483 tempest-VolumesGetTest-107668911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8" returned: 0 in 0.466s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bb0bc288-0eae-48af-8a97-0e2652795483 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:33 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fabda606-2419-4d81-9c3a-a00cecc15947 Sep 09 18:22:33 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:33 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8 Sep 09 18:22:33 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:33 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_01e36f3e-5a51-4193-821a-35d6dd5d89a5_q6xbnna5devstack@QuobyteHD" returned: 0 in 0.455s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Temporary image 01e36f3e-5a51-4193-821a-35d6dd5d89a5 is fetched for user 681cc1f52f6e4e86a109218829d0e9d8. {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3139f2-c87d-49ec-bce9-d8c797b2f5f1]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_01e36f3e-5a51-4193-821a-35d6dd5d89a5_q6xbnna5devstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:33 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_01e36f3e-5a51-4193-821a-35d6dd5d89a5_q6xbnna5devstack@QuobyteHD Sep 09 18:22:33 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:33 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bb0bc288-0eae-48af-8a97-0e2652795483 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8" returned: 0 in 0.347s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bb0bc288-0eae-48af-8a97-0e2652795483 tempest-VolumesGetTest-107668911 None] Lock "cinder-quobyte-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8" released by "delete_volume" :: held 0.870s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:33 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fabda606-2419-4d81-9c3a-a00cecc15947" returned: 0 in 0.408s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b23405d-61fa-4ccf-b245-809174f5d870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fabda606-2419-4d81-9c3a-a00cecc15947', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9424aee1-e138-451b-bca2-66ed5d1a18a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:33 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Volume volume-fabda606-2419-4d81-9c3a-a00cecc15947 (fabda606-2419-4d81-9c3a-a00cecc15947): created successfully Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9424aee1-e138-451b-bca2-66ed5d1a18a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Flow 'volume_create_manager' (8cf1f95a-72a0-43c5-9650-2396be5b7301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:33 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-70278e7d-c91c-4036-ad52-0fbe4c7d1b8c tempest-VolumesServicesTestJSON-100890608 None] Created volume successfully. Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-bb0bc288-0eae-48af-8a97-0e2652795483 tempest-VolumesGetTest-107668911 None] Created reservations ['fd66984a-8bd1-402c-93bd-ab64afa61f5c', '90062c78-1d52-4bd3-8222-319af5451560', 'a8672a22-b1fb-4881-862a-007364213bea', '0cc31c8d-df24-46f1-8e99-5f6213b8d986'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bb0bc288-0eae-48af-8a97-0e2652795483 tempest-VolumesGetTest-107668911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bb0bc288-0eae-48af-8a97-0e2652795483 tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-bb0bc288-0eae-48af-8a97-0e2652795483 tempest-VolumesGetTest-107668911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-bb0bc288-0eae-48af-8a97-0e2652795483 tempest-VolumesGetTest-107668911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bb0bc288-0eae-48af-8a97-0e2652795483 tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bb0bc288-0eae-48af-8a97-0e2652795483 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:33 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:22:33 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:33 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_01e36f3e-5a51-4193-821a-35d6dd5d89a5_q6xbnna5devstack@QuobyteHD" returned: 0 in 0.401s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-890347831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa0ce66-642c-4f68-94cd-736e34ef801e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35adbcf27dbd43528ef29daec1cde513',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:27Z,use_quota=True,user_id='681cc1f52f6e4e86a109218829d0e9d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a5101ad-f55f-4965-bca2-b61c7cd50aa7),volume_type_id=9a5101ad-f55f-4965-bca2-b61c7cd50aa7)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Creating volume 2aa0ce66-642c-4f68-94cd-736e34ef801e {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:22:33 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:22:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2aa0ce66-642c-4f68-94cd-736e34ef801e 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:33 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2aa0ce66-642c-4f68-94cd-736e34ef801e 1073741824 Sep 09 18:22:33 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:34 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bb0bc288-0eae-48af-8a97-0e2652795483 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.279s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:34 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-bb0bc288-0eae-48af-8a97-0e2652795483 tempest-VolumesGetTest-107668911 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:22:34 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-bb0bc288-0eae-48af-8a97-0e2652795483 tempest-VolumesGetTest-107668911 None] Deleted volume successfully. Sep 09 18:22:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bb0bc288-0eae-48af-8a97-0e2652795483 tempest-VolumesGetTest-107668911 None] Lock "cinder-96072c9e-bc74-4c6a-abd6-c4152f3ddfe8-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:34 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2aa0ce66-642c-4f68-94cd-736e34ef801e 1073741824" returned: 0 in 0.451s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2aa0ce66-642c-4f68-94cd-736e34ef801e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:34 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2aa0ce66-642c-4f68-94cd-736e34ef801e Sep 09 18:22:34 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:34 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2aa0ce66-642c-4f68-94cd-736e34ef801e" returned: 0 in 0.277s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:22:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:34 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Attempting download of 01e36f3e-5a51-4193-821a-35d6dd5d89a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/01e36f3e-5a51-4193-821a-35d6dd5d89a5', 'metadata': {}}])) to volume 2aa0ce66-642c-4f68-94cd-736e34ef801e. {{(pid=87639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 18:22:34 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb11960b-b120-4019-80b6-c6ef6e8ccc98]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-47b89aa3-3b29-4fb8-9992-c698cb9232cf tempest-VolumesServicesTestJSON-100890608 None] Acquiring lock "cinder-fabda606-2419-4d81-9c3a-a00cecc15947-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01e36f3e-5a51-4193-821a-35d6dd5d89a5_8k7sv0vp {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-47b89aa3-3b29-4fb8-9992-c698cb9232cf tempest-VolumesServicesTestJSON-100890608 None] Lock "cinder-fabda606-2419-4d81-9c3a-a00cecc15947-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-47b89aa3-3b29-4fb8-9992-c698cb9232cf tempest-VolumesServicesTestJSON-100890608 None] Acquiring lock "cinder-quobyte-fabda606-2419-4d81-9c3a-a00cecc15947" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-47b89aa3-3b29-4fb8-9992-c698cb9232cf tempest-VolumesServicesTestJSON-100890608 None] Lock "cinder-quobyte-fabda606-2419-4d81-9c3a-a00cecc15947" acquired by "delete_volume" :: waited 0.030s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:34 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ce0343-f6bc-4216-a8fb-130c6f22b68e]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-47b89aa3-3b29-4fb8-9992-c698cb9232cf tempest-VolumesServicesTestJSON-100890608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fabda606-2419-4d81-9c3a-a00cecc15947 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:34 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01e36f3e-5a51-4193-821a-35d6dd5d89a5_8k7sv0vp Sep 09 18:22:34 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-13c23af8-430c-4526-b9fc-35b346fb823e tempest-VolumesGetTest-107668911 None] Acquiring lock "cinder-79bccd59-4d6e-4835-8269-c1f188841e59-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-13c23af8-430c-4526-b9fc-35b346fb823e tempest-VolumesGetTest-107668911 None] Lock "cinder-79bccd59-4d6e-4835-8269-c1f188841e59-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:35 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fabda606-2419-4d81-9c3a-a00cecc15947 Sep 09 18:22:35 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-13c23af8-430c-4526-b9fc-35b346fb823e tempest-VolumesGetTest-107668911 None] Acquiring lock "cinder-quobyte-79bccd59-4d6e-4835-8269-c1f188841e59" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-13c23af8-430c-4526-b9fc-35b346fb823e tempest-VolumesGetTest-107668911 None] Lock "cinder-quobyte-79bccd59-4d6e-4835-8269-c1f188841e59" acquired by "delete_volume" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:35 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ef3173-110d-4062-b7ad-0d0ba99fab80]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-13c23af8-430c-4526-b9fc-35b346fb823e tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:35 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01e36f3e-5a51-4193-821a-35d6dd5d89a5_8k7sv0vp" returned: 0 in 0.473s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01e36f3e-5a51-4193-821a-35d6dd5d89a5_8k7sv0vp {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:35 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59 Sep 09 18:22:35 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:35 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:35 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01e36f3e-5a51-4193-821a-35d6dd5d89a5_8k7sv0vp Sep 09 18:22:35 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-47b89aa3-3b29-4fb8-9992-c698cb9232cf tempest-VolumesServicesTestJSON-100890608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fabda606-2419-4d81-9c3a-a00cecc15947" returned: 0 in 0.493s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-47b89aa3-3b29-4fb8-9992-c698cb9232cf tempest-VolumesServicesTestJSON-100890608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fabda606-2419-4d81-9c3a-a00cecc15947 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:35 devstack sudo[99969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fabda606-2419-4d81-9c3a-a00cecc15947 Sep 09 18:22:35 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:35 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-13c23af8-430c-4526-b9fc-35b346fb823e tempest-VolumesGetTest-107668911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59" returned: 0 in 0.484s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-13c23af8-430c-4526-b9fc-35b346fb823e tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:35 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01e36f3e-5a51-4193-821a-35d6dd5d89a5_8k7sv0vp" returned: 1 in 0.435s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01e36f3e-5a51-4193-821a-35d6dd5d89a5_8k7sv0vp' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:22:35 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d552ff8-aa5f-4590-8fd2-cd9667b44f54]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_01e36f3e-5a51-4193-821a-35d6dd5d89a5_q6xbnna5devstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:35 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59 Sep 09 18:22:35 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:35 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-47b89aa3-3b29-4fb8-9992-c698cb9232cf tempest-VolumesServicesTestJSON-100890608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fabda606-2419-4d81-9c3a-a00cecc15947" returned: 0 in 0.351s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-47b89aa3-3b29-4fb8-9992-c698cb9232cf tempest-VolumesServicesTestJSON-100890608 None] Lock "cinder-quobyte-fabda606-2419-4d81-9c3a-a00cecc15947" released by "delete_volume" :: held 0.916s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:35 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_01e36f3e-5a51-4193-821a-35d6dd5d89a5_q6xbnna5devstack@QuobyteHD Sep 09 18:22:35 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:35 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-47b89aa3-3b29-4fb8-9992-c698cb9232cf tempest-VolumesServicesTestJSON-100890608 None] Created reservations ['45815fd1-426d-448c-9b91-3e7d0dbed066', 'b32d1a03-e089-4f55-a1d7-2b999ee42314', 'a281a48c-146e-4133-a08d-7165db3ca03a', 'd0df393c-f2db-4d1d-914d-aa7cff302f87'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:22:35 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-13c23af8-430c-4526-b9fc-35b346fb823e tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-79bccd59-4d6e-4835-8269-c1f188841e59" returned: 0 in 0.308s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-13c23af8-430c-4526-b9fc-35b346fb823e tempest-VolumesGetTest-107668911 None] Lock "cinder-quobyte-79bccd59-4d6e-4835-8269-c1f188841e59" released by "delete_volume" :: held 0.891s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-47b89aa3-3b29-4fb8-9992-c698cb9232cf tempest-VolumesServicesTestJSON-100890608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-47b89aa3-3b29-4fb8-9992-c698cb9232cf tempest-VolumesServicesTestJSON-100890608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-47b89aa3-3b29-4fb8-9992-c698cb9232cf tempest-VolumesServicesTestJSON-100890608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-47b89aa3-3b29-4fb8-9992-c698cb9232cf tempest-VolumesServicesTestJSON-100890608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-47b89aa3-3b29-4fb8-9992-c698cb9232cf tempest-VolumesServicesTestJSON-100890608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-47b89aa3-3b29-4fb8-9992-c698cb9232cf tempest-VolumesServicesTestJSON-100890608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:36 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:22:36 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-13c23af8-430c-4526-b9fc-35b346fb823e tempest-VolumesGetTest-107668911 None] Created reservations ['eb537bdd-a7e3-4434-9c0e-579836b0e97e', 'd3aff8a9-2710-43e2-bdc5-e1ed000e5794', 'b1633451-f9c3-4dc9-8694-48181327f771', '42844abe-05dc-4e3f-8628-769913ee3e78'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:22:36 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_01e36f3e-5a51-4193-821a-35d6dd5d89a5_q6xbnna5devstack@QuobyteHD" returned: 0 in 0.495s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] 01e36f3e-5a51-4193-821a-35d6dd5d89a5 was qcow2, converting to qcow2 {{(pid=87639) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_01e36f3e-5a51-4193-821a-35d6dd5d89a5_q6xbnna5devstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2aa0ce66-642c-4f68-94cd-736e34ef801e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:36 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_01e36f3e-5a51-4193-821a-35d6dd5d89a5_q6xbnna5devstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2aa0ce66-642c-4f68-94cd-736e34ef801e Sep 09 18:22:36 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-13c23af8-430c-4526-b9fc-35b346fb823e tempest-VolumesGetTest-107668911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-13c23af8-430c-4526-b9fc-35b346fb823e tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-13c23af8-430c-4526-b9fc-35b346fb823e tempest-VolumesGetTest-107668911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-13c23af8-430c-4526-b9fc-35b346fb823e tempest-VolumesGetTest-107668911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-13c23af8-430c-4526-b9fc-35b346fb823e tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-13c23af8-430c-4526-b9fc-35b346fb823e tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:36 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:22:36 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:36 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-47b89aa3-3b29-4fb8-9992-c698cb9232cf tempest-VolumesServicesTestJSON-100890608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.401s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-47b89aa3-3b29-4fb8-9992-c698cb9232cf tempest-VolumesServicesTestJSON-100890608 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6d320c84-0872-467a-9495-d07c1947a3bc tempest-VolumesNegativeTest-1010116564 None] Acquiring lock "cinder-116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:36 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-47b89aa3-3b29-4fb8-9992-c698cb9232cf tempest-VolumesServicesTestJSON-100890608 None] Deleted volume successfully. Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6d320c84-0872-467a-9495-d07c1947a3bc tempest-VolumesNegativeTest-1010116564 None] Lock "cinder-116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-47b89aa3-3b29-4fb8-9992-c698cb9232cf tempest-VolumesServicesTestJSON-100890608 None] Lock "cinder-fabda606-2419-4d81-9c3a-a00cecc15947-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6d320c84-0872-467a-9495-d07c1947a3bc tempest-VolumesNegativeTest-1010116564 None] Acquiring lock "cinder-quobyte-116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6d320c84-0872-467a-9495-d07c1947a3bc tempest-VolumesNegativeTest-1010116564 None] Lock "cinder-quobyte-116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6" acquired by "delete_volume" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[460291c3-ab99-49a1-8788-896610bb5556]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6d320c84-0872-467a-9495-d07c1947a3bc tempest-VolumesNegativeTest-1010116564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:36 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-13c23af8-430c-4526-b9fc-35b346fb823e tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.351s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-13c23af8-430c-4526-b9fc-35b346fb823e tempest-VolumesGetTest-107668911 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:22:36 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-13c23af8-430c-4526-b9fc-35b346fb823e tempest-VolumesGetTest-107668911 None] Deleted volume successfully. Sep 09 18:22:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-13c23af8-430c-4526-b9fc-35b346fb823e tempest-VolumesGetTest-107668911 None] Lock "cinder-79bccd59-4d6e-4835-8269-c1f188841e59-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:36 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6 Sep 09 18:22:36 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:37 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6d320c84-0872-467a-9495-d07c1947a3bc tempest-VolumesNegativeTest-1010116564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6" returned: 0 in 0.411s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6d320c84-0872-467a-9495-d07c1947a3bc tempest-VolumesNegativeTest-1010116564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:37 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6 Sep 09 18:22:37 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:37 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6d320c84-0872-467a-9495-d07c1947a3bc tempest-VolumesNegativeTest-1010116564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6" returned: 0 in 0.300s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6d320c84-0872-467a-9495-d07c1947a3bc tempest-VolumesNegativeTest-1010116564 None] Lock "cinder-quobyte-116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6" released by "delete_volume" :: held 0.762s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:37 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-6d320c84-0872-467a-9495-d07c1947a3bc tempest-VolumesNegativeTest-1010116564 None] Created reservations ['443608d6-f363-48b2-90c2-73ec8be36fa3', 'f9d6c37b-3fe8-4d18-b752-f5c988c56468', 'd044ae89-528c-4aad-a916-c9144a078579', '0417c26c-5aa5-426b-bb17-abd40735aff9'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:22:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6d320c84-0872-467a-9495-d07c1947a3bc tempest-VolumesNegativeTest-1010116564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6d320c84-0872-467a-9495-d07c1947a3bc tempest-VolumesNegativeTest-1010116564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6d320c84-0872-467a-9495-d07c1947a3bc tempest-VolumesNegativeTest-1010116564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6d320c84-0872-467a-9495-d07c1947a3bc tempest-VolumesNegativeTest-1010116564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6d320c84-0872-467a-9495-d07c1947a3bc tempest-VolumesNegativeTest-1010116564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6d320c84-0872-467a-9495-d07c1947a3bc tempest-VolumesNegativeTest-1010116564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:37 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:22:37 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:37 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6d320c84-0872-467a-9495-d07c1947a3bc tempest-VolumesNegativeTest-1010116564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.425s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:37 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-6d320c84-0872-467a-9495-d07c1947a3bc tempest-VolumesNegativeTest-1010116564 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:22:37 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-6d320c84-0872-467a-9495-d07c1947a3bc tempest-VolumesNegativeTest-1010116564 None] Deleted volume successfully. Sep 09 18:22:38 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6d320c84-0872-467a-9495-d07c1947a3bc tempest-VolumesNegativeTest-1010116564 None] Lock "cinder-116be561-d7cc-4f21-bb6d-3ccd3d1d4ac6-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:38 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:22:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Flow 'volume_create_manager' (42b836d9-fdc4-4f00-99c1-969defd980c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3796709-623d-4fed-bb17-023dea8ad92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3796709-623d-4fed-bb17-023dea8ad92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-650900895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6a2b4c-2657-4915-adee-d466b480c2ec,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7d3ce03c12284a488de533e75a8321b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:38Z,use_quota=True,user_id='3dd44c266c384085b5d209600e46aa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9723749-b1b3-4b83-ab45-4d0667b9eae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9723749-b1b3-4b83-ab45-4d0667b9eae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489b9383-fba6-47d3-a47a-2c8ea69340e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:38 devstack cinder-volume[87639]: DEBUG cinder.image.glance [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Creating Keystone auth plugin from conf {{(pid=87639) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 18:22:38 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_01e36f3e-5a51-4193-821a-35d6dd5d89a5_q6xbnna5devstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2aa0ce66-642c-4f68-94cd-736e34ef801e" returned: 0 in 2.476s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:38 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_01e36f3e-5a51-4193-821a-35d6dd5d89a5_q6xbnna5devstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2aa0ce66-642c-4f68-94cd-736e34ef801e {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:22:38 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Converted 112.00 MB image at 45.21 MB/s Sep 09 18:22:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2aa0ce66-642c-4f68-94cd-736e34ef801e 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:38 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2aa0ce66-642c-4f68-94cd-736e34ef801e 1G Sep 09 18:22:38 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489b9383-fba6-47d3-a47a-2c8ea69340e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dc6a2b4c-2657-4915-adee-d466b480c2ec', 'volume_name': 'volume-dc6a2b4c-2657-4915-adee-d466b480c2ec', 'volume_size': 1, 'image_id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7ff1e5c089804fe694a8f7d1bf0a7374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'created_at': datetime.datetime(2026, 9, 9, 16, 5, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 5, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab292626-e7bc-4d49-ab2d-815654d7c1d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab292626-e7bc-4d49-ab2d-815654d7c1d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e137c45-b7f2-4722-ad1b-0574e4934d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:38 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Volume dc6a2b4c-2657-4915-adee-d466b480c2ec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dc6a2b4c-2657-4915-adee-d466b480c2ec', 'volume_size': 1, 'image_id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7ff1e5c089804fe694a8f7d1bf0a7374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'created_at': datetime.datetime(2026, 9, 9, 16, 5, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 5, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 18:22:38 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Trying to clone dc6a2b4c-2657-4915-adee-d466b480c2ec from image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}]). {{(pid=87639) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 18:22:39 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2aa0ce66-642c-4f68-94cd-736e34ef801e 1G" returned: 0 in 0.515s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:39 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Downloaded image 01e36f3e-5a51-4193-821a-35d6dd5d89a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/01e36f3e-5a51-4193-821a-35d6dd5d89a5', 'metadata': {}}])) to volume 2aa0ce66-642c-4f68-94cd-736e34ef801e successfully. {{(pid=87639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 18:22:39 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Temporary image 01e36f3e-5a51-4193-821a-35d6dd5d89a5 for user 681cc1f52f6e4e86a109218829d0e9d8 is deleted. {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 18:22:39 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Marking volume 2aa0ce66-642c-4f68-94cd-736e34ef801e as bootable. {{(pid=87639) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 18:22:39 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Copying metadata from image 01e36f3e-5a51-4193-821a-35d6dd5d89a5 to 2aa0ce66-642c-4f68-94cd-736e34ef801e. {{(pid=87639) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 18:22:39 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Creating volume glance metadata for volume 2aa0ce66-642c-4f68-94cd-736e34ef801e backed by image 01e36f3e-5a51-4193-821a-35d6dd5d89a5 with: {'image_id': '01e36f3e-5a51-4193-821a-35d6dd5d89a5', 'image_name': 'tempest-scenario-img--1486416506', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87639) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 18:22:39 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_yojzygcpdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 18:22:39 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Image download 20.69 MB at 20.69 MB/s Sep 09 18:22:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37997864-0fdc-4a00-829f-0a62ae39b2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aa0ce66-642c-4f68-94cd-736e34ef801e', 'volume_size': 1, 'image_id': '01e36f3e-5a51-4193-821a-35d6dd5d89a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01e36f3e-5a51-4193-821a-35d6dd5d89a5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1486416506', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '35adbcf27dbd43528ef29daec1cde513', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '01e36f3e-5a51-4193-821a-35d6dd5d89a5', 'created_at': datetime.datetime(2026, 9, 9, 16, 22, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 22, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01e36f3e-5a51-4193-821a-35d6dd5d89a5/file', 'properties': {}}, 'image_service': }' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae6e027-2037-48a0-bb6c-5e34ed464869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:39 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Volume volume-2aa0ce66-642c-4f68-94cd-736e34ef801e (2aa0ce66-642c-4f68-94cd-736e34ef801e): created successfully Sep 09 18:22:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae6e027-2037-48a0-bb6c-5e34ed464869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Flow 'volume_create_manager' (179386b0-8b20-4da4-80b8-dfa8940f0139) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:39 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87d82b7-8b7d-46be-87c3-73662c7150eb]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_yojzygcpdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:39 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-74516fc6-69a3-49fa-a5f2-4d7f3f672996 tempest-TestInstancesWithCinderVolumes-1868759752 None] Created volume successfully. Sep 09 18:22:39 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_yojzygcpdevstack@QuobyteHD Sep 09 18:22:39 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:39 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_yojzygcpdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:39 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Temporary image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 is fetched for user 3dd44c266c384085b5d209600e46aa90. {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 18:22:39 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36ff76d-6d78-45a9-bafd-d1689360a851]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_yojzygcpdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:40 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_yojzygcpdevstack@QuobyteHD Sep 09 18:22:40 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:40 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_yojzygcpdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-650900895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6a2b4c-2657-4915-adee-d466b480c2ec,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7d3ce03c12284a488de533e75a8321b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:38Z,use_quota=True,user_id='3dd44c266c384085b5d209600e46aa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:22:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Creating volume dc6a2b4c-2657-4915-adee-d466b480c2ec {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:22:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:22:40 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:22:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc6a2b4c-2657-4915-adee-d466b480c2ec 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:40 devstack sudo[100033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc6a2b4c-2657-4915-adee-d466b480c2ec 1073741824 Sep 09 18:22:40 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:40 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc6a2b4c-2657-4915-adee-d466b480c2ec 1073741824" returned: 0 in 0.487s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc6a2b4c-2657-4915-adee-d466b480c2ec {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:40 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc6a2b4c-2657-4915-adee-d466b480c2ec Sep 09 18:22:40 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:41 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc6a2b4c-2657-4915-adee-d466b480c2ec" returned: 0 in 0.275s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:41 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:22:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:41 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Attempting download of 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 ((None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}])) to volume dc6a2b4c-2657-4915-adee-d466b480c2ec. {{(pid=87639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 18:22:41 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[100c61e2-2995-4e0e-9a5a-fe7718da13a7]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_3ftj1mt1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:41 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_3ftj1mt1 Sep 09 18:22:41 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:41 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_3ftj1mt1" returned: 0 in 0.483s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_3ftj1mt1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:41 devstack sudo[100049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_3ftj1mt1 Sep 09 18:22:41 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:42 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Flow 'volume_create_manager' (25176889-884c-495c-9989-bf6efa1da1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4342a2d8-ecb6-43e9-aacc-0ca5b2c8f046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_3ftj1mt1" returned: 1 in 0.632s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_3ftj1mt1' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21bdc9b-b458-4e5a-a3e5-84a58f02f446]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_yojzygcpdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4342a2d8-ecb6-43e9-aacc-0ca5b2c8f046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1062543060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c6947f-ab06-48c2-9e20-16c62f44a46c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a5dbff5da74a5d993076c1ef9caa3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:42Z,use_quota=True,user_id='b67990474e7e4386b1d2bd933f0b8c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ca1801-f085-4518-85fb-635b6d42a6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ca1801-f085-4518-85fb-635b6d42a6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1872c01-ae70-471c-9764-edd62f506b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1872c01-ae70-471c-9764-edd62f506b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09c6947f-ab06-48c2-9e20-16c62f44a46c', 'volume_name': 'volume-09c6947f-ab06-48c2-9e20-16c62f44a46c', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ac9a3a-7233-4cd5-b0b0-e7da6a3c9ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ac9a3a-7233-4cd5-b0b0-e7da6a3c9ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386f2cf5-40f2-4b4f-93a5-903c8ce4b892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:42 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Volume 09c6947f-ab06-48c2-9e20-16c62f44a46c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09c6947f-ab06-48c2-9e20-16c62f44a46c', 'volume_size': 1} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1062543060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c6947f-ab06-48c2-9e20-16c62f44a46c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a5dbff5da74a5d993076c1ef9caa3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:42Z,use_quota=True,user_id='b67990474e7e4386b1d2bd933f0b8c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Creating volume 09c6947f-ab06-48c2-9e20-16c62f44a46c {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:22:42 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:42 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_yojzygcpdevstack@QuobyteHD Sep 09 18:22:42 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:42 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c 1073741824 Sep 09 18:22:42 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:42 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_yojzygcpdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 was qcow2, converting to qcow2 {{(pid=87639) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 18:22:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_yojzygcpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc6a2b4c-2657-4915-adee-d466b480c2ec {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:42 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_yojzygcpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc6a2b4c-2657-4915-adee-d466b480c2ec Sep 09 18:22:42 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:43 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c 1073741824" returned: 0 in 0.675s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:43 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c Sep 09 18:22:43 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:43 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:22:43 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:43 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.470s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 29 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:22:43 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c" returned: 0 in 0.574s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (386f2cf5-40f2-4b4f-93a5-903c8ce4b892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09c6947f-ab06-48c2-9e20-16c62f44a46c', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1044629-4f33-4f75-b251-0e0cf9be0db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:43 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Volume volume-09c6947f-ab06-48c2-9e20-16c62f44a46c (09c6947f-ab06-48c2-9e20-16c62f44a46c): created successfully Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1044629-4f33-4f75-b251-0e0cf9be0db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Flow 'volume_create_manager' (25176889-884c-495c-9989-bf6efa1da1a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-6667e898-f25f-42a3-aa67-7ed22a31547a req-affb97d9-4e15-4196-a132-7af2da80d0eb tempest-TestInstancesWithCinderVolumes-1868759752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-6667e898-f25f-42a3-aa67-7ed22a31547a req-affb97d9-4e15-4196-a132-7af2da80d0eb tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:43 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-f29bd9d2-4639-47f2-9982-be46a5c55845 tempest-CreateVolumesFromSnapshotTest-847186939 None] Created volume successfully. Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-6667e898-f25f-42a3-aa67-7ed22a31547a req-affb97d9-4e15-4196-a132-7af2da80d0eb tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-6667e898-f25f-42a3-aa67-7ed22a31547a req-affb97d9-4e15-4196-a132-7af2da80d0eb tempest-TestInstancesWithCinderVolumes-1868759752 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-2aa0ce66-642c-4f68-94cd-736e34ef801e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f1d9ed32-57dc-4178-95e7-276ca19c9376', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:22:44 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-6667e898-f25f-42a3-aa67-7ed22a31547a req-affb97d9-4e15-4196-a132-7af2da80d0eb tempest-TestInstancesWithCinderVolumes-1868759752 None] attachment_update completed successfully. Sep 09 18:22:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2a1b6425-6145-4186-ab82-72c91f907c20 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2a1b6425-6145-4186-ab82-72c91f907c20 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:44 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-2a1b6425-6145-4186-ab82-72c91f907c20 tempest-CreateVolumesFromSnapshotTest-847186939 None] Creating offline snapshot 71eb9621-3695-4edf-916c-6bb411853cfc of volume 09c6947f-ab06-48c2-9e20-16c62f44a46c {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:22:44 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4ff3bc-ef48-46f7-b685-80cfd07e4c37]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a1b6425-6145-4186-ab82-72c91f907c20 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:44 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c Sep 09 18:22:44 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:45 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a1b6425-6145-4186-ab82-72c91f907c20 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c" returned: 0 in 0.501s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a1b6425-6145-4186-ab82-72c91f907c20 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.71eb9621-3695-4edf-916c-6bb411853cfc 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:45 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.71eb9621-3695-4edf-916c-6bb411853cfc 1G Sep 09 18:22:45 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:45 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_yojzygcpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc6a2b4c-2657-4915-adee-d466b480c2ec" returned: 0 in 2.703s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:45 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_yojzygcpdevstack@QuobyteHD, size 112.00 MB, duration 2.71 sec, destination /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc6a2b4c-2657-4915-adee-d466b480c2ec {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:22:45 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Converted 112.00 MB image at 41.40 MB/s Sep 09 18:22:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc6a2b4c-2657-4915-adee-d466b480c2ec 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:45 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc6a2b4c-2657-4915-adee-d466b480c2ec 1G Sep 09 18:22:45 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:45 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a1b6425-6145-4186-ab82-72c91f907c20 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.71eb9621-3695-4edf-916c-6bb411853cfc 1G" returned: 0 in 0.614s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a1b6425-6145-4186-ab82-72c91f907c20 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09c6947f-ab06-48c2-9e20-16c62f44a46c -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.71eb9621-3695-4edf-916c-6bb411853cfc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:45 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc6a2b4c-2657-4915-adee-d466b480c2ec 1G" returned: 0 in 0.486s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:45 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Downloaded image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 ((None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}])) to volume dc6a2b4c-2657-4915-adee-d466b480c2ec successfully. {{(pid=87639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 18:22:45 devstack sudo[100108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09c6947f-ab06-48c2-9e20-16c62f44a46c -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.71eb9621-3695-4edf-916c-6bb411853cfc Sep 09 18:22:45 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:45 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Temporary image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 for user 3dd44c266c384085b5d209600e46aa90 is deleted. {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 18:22:45 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Marking volume dc6a2b4c-2657-4915-adee-d466b480c2ec as bootable. {{(pid=87639) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 18:22:45 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Copying metadata from image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 to dc6a2b4c-2657-4915-adee-d466b480c2ec. {{(pid=87639) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 18:22:45 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Creating volume glance metadata for volume dc6a2b4c-2657-4915-adee-d466b480c2ec backed by image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87639) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 18:22:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e137c45-b7f2-4722-ad1b-0574e4934d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc6a2b4c-2657-4915-adee-d466b480c2ec', 'volume_size': 1, 'image_id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7ff1e5c089804fe694a8f7d1bf0a7374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'created_at': datetime.datetime(2026, 9, 9, 16, 5, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 5, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bea2df2-b316-4acc-9945-e200f8757b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:46 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Volume volume-dc6a2b4c-2657-4915-adee-d466b480c2ec (dc6a2b4c-2657-4915-adee-d466b480c2ec): created successfully Sep 09 18:22:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bea2df2-b316-4acc-9945-e200f8757b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Flow 'volume_create_manager' (42b836d9-fdc4-4f00-99c1-969defd980c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:46 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-afa27ce2-0e4f-4c01-a5e1-8a3f90c2b170 tempest-VolumesGetTest-107668911 None] Created volume successfully. Sep 09 18:22:46 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a1b6425-6145-4186-ab82-72c91f907c20 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09c6947f-ab06-48c2-9e20-16c62f44a46c -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.71eb9621-3695-4edf-916c-6bb411853cfc" returned: 0 in 0.351s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:46 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-2a1b6425-6145-4186-ab82-72c91f907c20 tempest-CreateVolumesFromSnapshotTest-847186939 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.71eb9621-3695-4edf-916c-6bb411853cfc is being set with open permissions: ugo+rw Sep 09 18:22:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a1b6425-6145-4186-ab82-72c91f907c20 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.71eb9621-3695-4edf-916c-6bb411853cfc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:46 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.71eb9621-3695-4edf-916c-6bb411853cfc Sep 09 18:22:46 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:46 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a1b6425-6145-4186-ab82-72c91f907c20 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.71eb9621-3695-4edf-916c-6bb411853cfc" returned: 0 in 0.302s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a1b6425-6145-4186-ab82-72c91f907c20 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:46 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.info Sep 09 18:22:46 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:46 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a1b6425-6145-4186-ab82-72c91f907c20 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.info" returned: 0 in 0.349s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:46 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-2a1b6425-6145-4186-ab82-72c91f907c20 tempest-CreateVolumesFromSnapshotTest-847186939 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.info is being set with open permissions: ugo+rw Sep 09 18:22:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a1b6425-6145-4186-ab82-72c91f907c20 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:47 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.info Sep 09 18:22:47 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:47 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a1b6425-6145-4186-ab82-72c91f907c20 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.info" returned: 0 in 0.572s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2a1b6425-6145-4186-ab82-72c91f907c20 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.837s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:47 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-2a1b6425-6145-4186-ab82-72c91f907c20 tempest-CreateVolumesFromSnapshotTest-847186939 None] Create snapshot completed successfully Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Flow 'volume_create_manager' (a7a2a98a-6e95-4cf9-9a21-e4398fb3983d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b09ca7-d44f-405c-9816-784dbabd7ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00b09ca7-d44f-405c-9816-784dbabd7ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-156026963',display_name='tempest-VolumesGetTest-Volume-801073075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d3ce03c12284a488de533e75a8321b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:48Z,use_quota=True,user_id='3dd44c266c384085b5d209600e46aa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f51c0f80-6677-4a54-926f-50f2ad27d9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f51c0f80-6677-4a54-926f-50f2ad27d9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e6130b9-d6a9-4093-9f88-bb3894bf0c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e6130b9-d6a9-4093-9f88-bb3894bf0c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad', 'volume_name': 'volume-31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d5db9f-3675-44f1-90cd-4051d5326351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d5db9f-3675-44f1-90cd-4051d5326351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5484987e-f02f-415d-afb3-0c6a3f00dc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:48 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Volume 31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad', 'volume_size': 1} Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-156026963',display_name='tempest-VolumesGetTest-Volume-801073075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d3ce03c12284a488de533e75a8321b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:48Z,use_quota=True,user_id='3dd44c266c384085b5d209600e46aa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Creating volume 31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:22:48 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:48 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad 1073741824 Sep 09 18:22:48 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:48 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:22:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Flow 'volume_create_manager' (b5568cfa-75c8-4d83-b976-92a2edbd4242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d127a5-4363-44c0-9ff4-0fbe53da9157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49d127a5-4363-44c0-9ff4-0fbe53da9157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1451561559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0353972b-fd8b-42c6-8c43-7e668beaffa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a5dbff5da74a5d993076c1ef9caa3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:49Z,use_quota=True,user_id='b67990474e7e4386b1d2bd933f0b8c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e811611d-bcef-4fe5-8692-eb6394c4f868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e811611d-bcef-4fe5-8692-eb6394c4f868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cfd7b57-e8a6-43bf-be22-3112ff07b221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cfd7b57-e8a6-43bf-be22-3112ff07b221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0353972b-fd8b-42c6-8c43-7e668beaffa1', 'volume_name': 'volume-0353972b-fd8b-42c6-8c43-7e668beaffa1', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62dafa42-c36f-4587-93d8-22efd056ea08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62dafa42-c36f-4587-93d8-22efd056ea08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b4dc0b-ddb1-4547-9633-77c9d02a684e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:49 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Volume 0353972b-fd8b-42c6-8c43-7e668beaffa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0353972b-fd8b-42c6-8c43-7e668beaffa1', 'volume_size': 1} Sep 09 18:22:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:49 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad 1073741824" returned: 0 in 0.686s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:49 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad Sep 09 18:22:49 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:49 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:22:50 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Flow 'volume_create_manager' (b6bd937b-dcd4-43e3-8b05-91e7ce3e38f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b1b914-8305-4f5f-b108-71e91d8c4475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad" returned: 0 in 0.490s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1451561559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0353972b-fd8b-42c6-8c43-7e668beaffa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a5dbff5da74a5d993076c1ef9caa3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:49Z,use_quota=True,user_id='b67990474e7e4386b1d2bd933f0b8c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Creating volume 0353972b-fd8b-42c6-8c43-7e668beaffa1 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:22:50 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0353972b-fd8b-42c6-8c43-7e668beaffa1 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b1b914-8305-4f5f-b108-71e91d8c4475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-388784201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aeab283-ac66-4209-9461-341e7fe89a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a5dbff5da74a5d993076c1ef9caa3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:50Z,use_quota=True,user_id='b67990474e7e4386b1d2bd933f0b8c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118a10f0-d393-4ff8-b6aa-43cffec8321f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:50 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0353972b-fd8b-42c6-8c43-7e668beaffa1 1073741824 Sep 09 18:22:50 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (118a10f0-d393-4ff8-b6aa-43cffec8321f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (454b8ce8-291b-4e79-8005-dd565baf6a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (454b8ce8-291b-4e79-8005-dd565baf6a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aeab283-ac66-4209-9461-341e7fe89a0e', 'volume_name': 'volume-8aeab283-ac66-4209-9461-341e7fe89a0e', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3070369d-a3f0-4f11-9239-97d5c77faab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3070369d-a3f0-4f11-9239-97d5c77faab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a379ef4d-16db-4e1d-875c-3208b18d9a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:50 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Volume 8aeab283-ac66-4209-9461-341e7fe89a0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aeab283-ac66-4209-9461-341e7fe89a0e', 'volume_size': 1} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5484987e-f02f-415d-afb3-0c6a3f00dc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aaf8381-195d-4862-ace2-5fc9b984f291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:50 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Volume volume-31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad (31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad): created successfully Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aaf8381-195d-4862-ace2-5fc9b984f291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Flow 'volume_create_manager' (a7a2a98a-6e95-4cf9-9a21-e4398fb3983d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:50 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-18402d6c-4f6a-4d6e-9757-3f421eb6fdc8 tempest-VolumesGetTest-107668911 None] Created volume successfully. Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Flow 'volume_create_manager' (c2c89260-08e0-4387-a487-5612e454e80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf1db6b-d89e-433d-8619-7c78584d525b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf1db6b-d89e-433d-8619-7c78584d525b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-924769034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463568cf-4c61-47ac-b161-12d6e773d380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a5dbff5da74a5d993076c1ef9caa3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:51Z,use_quota=True,user_id='b67990474e7e4386b1d2bd933f0b8c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f874ae6-fd9a-489f-97e7-5aaa51120f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f874ae6-fd9a-489f-97e7-5aaa51120f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:51 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448114f5-eef4-4597-b7ed-0019baf64e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448114f5-eef4-4597-b7ed-0019baf64e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '463568cf-4c61-47ac-b161-12d6e773d380', 'volume_name': 'volume-463568cf-4c61-47ac-b161-12d6e773d380', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d9efca-149a-493b-9ab2-6013e3fc5c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d9efca-149a-493b-9ab2-6013e3fc5c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c941fc-3bae-4479-b38f-171818e8c00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:51 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Volume 463568cf-4c61-47ac-b161-12d6e773d380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-463568cf-4c61-47ac-b161-12d6e773d380', 'volume_size': 1} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0353972b-fd8b-42c6-8c43-7e668beaffa1 1073741824" returned: 0 in 0.976s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-eefe9d0b-7a2e-4c72-addb-1b4e6328578d tempest-VolumesGetTest-107668911 None] Acquiring lock "cinder-31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0353972b-fd8b-42c6-8c43-7e668beaffa1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:22:51 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0353972b-fd8b-42c6-8c43-7e668beaffa1 Sep 09 18:22:51 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Flow 'volume_create_manager' (91d2c10a-f1bc-40ad-b383-c70790251caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed5b6e8-0129-4d38-b8c9-018ff9780017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-eefe9d0b-7a2e-4c72-addb-1b4e6328578d tempest-VolumesGetTest-107668911 None] Lock "cinder-31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad-delete_volume" acquired by "delete_volume" :: waited 0.163s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed5b6e8-0129-4d38-b8c9-018ff9780017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-570678251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7c850a-98de-4b60-8496-9aa5bd715d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a5dbff5da74a5d993076c1ef9caa3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:51Z,use_quota=True,user_id='b67990474e7e4386b1d2bd933f0b8c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7aa95a-dab0-4c8b-be0d-daae630f7f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7aa95a-dab0-4c8b-be0d-daae630f7f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5b2184-088e-4448-9b83-c37c23bcf633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5b2184-088e-4448-9b83-c37c23bcf633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c7c850a-98de-4b60-8496-9aa5bd715d54', 'volume_name': 'volume-0c7c850a-98de-4b60-8496-9aa5bd715d54', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64980086-4d55-43c7-a9ca-4657f6127744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64980086-4d55-43c7-a9ca-4657f6127744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e503a4c7-4891-440d-845a-695fc6cc557c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:51 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Volume 0c7c850a-98de-4b60-8496-9aa5bd715d54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c7c850a-98de-4b60-8496-9aa5bd715d54', 'volume_size': 1} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-eefe9d0b-7a2e-4c72-addb-1b4e6328578d tempest-VolumesGetTest-107668911 None] Acquiring lock "cinder-quobyte-31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-eefe9d0b-7a2e-4c72-addb-1b4e6328578d tempest-VolumesGetTest-107668911 None] Lock "cinder-quobyte-31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad" acquired by "delete_volume" :: waited 0.028s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac1df12-bdb3-4d71-831a-ce3e6badba3d]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eefe9d0b-7a2e-4c72-addb-1b4e6328578d tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:51 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad Sep 09 18:22:51 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:52 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0353972b-fd8b-42c6-8c43-7e668beaffa1" returned: 0 in 0.792s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] <== create_volume: return (1927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.797s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-388784201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aeab283-ac66-4209-9461-341e7fe89a0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a5dbff5da74a5d993076c1ef9caa3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:50Z,use_quota=True,user_id='b67990474e7e4386b1d2bd933f0b8c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Creating volume 8aeab283-ac66-4209-9461-341e7fe89a0e {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:22:52 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8aeab283-ac66-4209-9461-341e7fe89a0e 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:52 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8aeab283-ac66-4209-9461-341e7fe89a0e 1073741824 Sep 09 18:22:52 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32b4dc0b-ddb1-4547-9633-77c9d02a684e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0353972b-fd8b-42c6-8c43-7e668beaffa1', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2fd8d0-3e71-4a6d-839f-3c2b5feb326c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Flow 'volume_create_manager' (fbb0efd0-2888-41ee-96f5-342576492d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:52 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc34bcd9-2c97-4b8b-87cc-92efb66a95de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eefe9d0b-7a2e-4c72-addb-1b4e6328578d tempest-VolumesGetTest-107668911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad" returned: 0 in 0.716s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eefe9d0b-7a2e-4c72-addb-1b4e6328578d tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:52 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Volume volume-0353972b-fd8b-42c6-8c43-7e668beaffa1 (0353972b-fd8b-42c6-8c43-7e668beaffa1): created successfully Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2fd8d0-3e71-4a6d-839f-3c2b5feb326c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Flow 'volume_create_manager' (b5568cfa-75c8-4d83-b976-92a2edbd4242) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:52 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad Sep 09 18:22:52 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc34bcd9-2c97-4b8b-87cc-92efb66a95de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2132591793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a5dbff5da74a5d993076c1ef9caa3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:52Z,use_quota=True,user_id='b67990474e7e4386b1d2bd933f0b8c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26960de7-df4e-4a15-bb71-efcb1e5f595e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26960de7-df4e-4a15-bb71-efcb1e5f595e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70972de5-8652-4cd4-80d1-d7e127d2dbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70972de5-8652-4cd4-80d1-d7e127d2dbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b', 'volume_name': 'volume-a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea977e5-88af-4c19-b619-b35c61a04246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea977e5-88af-4c19-b619-b35c61a04246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc2d80f-c7f2-4e65-954c-2dc74c13a461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:52 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Volume a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b', 'volume_size': 1} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:52 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-07e22908-45f1-49c7-8a98-16e732dada09 tempest-CreateVolumesFromSnapshotTest-847186939 None] Created volume successfully. Sep 09 18:22:52 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8aeab283-ac66-4209-9461-341e7fe89a0e 1073741824" returned: 0 in 0.833s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8aeab283-ac66-4209-9461-341e7fe89a0e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:53 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8aeab283-ac66-4209-9461-341e7fe89a0e Sep 09 18:22:53 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:53 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eefe9d0b-7a2e-4c72-addb-1b4e6328578d tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad" returned: 0 in 0.670s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-eefe9d0b-7a2e-4c72-addb-1b4e6328578d tempest-VolumesGetTest-107668911 None] Lock "cinder-quobyte-31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad" released by "delete_volume" :: held 1.475s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-eefe9d0b-7a2e-4c72-addb-1b4e6328578d tempest-VolumesGetTest-107668911 None] Created reservations ['c8722599-16d1-4c02-8d59-71308127ec2f', '284fe086-9a20-4ff3-b8c9-0a74b4e771f5', '7474d7df-e808-453f-ace7-d95c400102fb', '8c640a95-7dfe-40ff-b3e8-75bba9b36fc8'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-eefe9d0b-7a2e-4c72-addb-1b4e6328578d tempest-VolumesGetTest-107668911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-eefe9d0b-7a2e-4c72-addb-1b4e6328578d tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-eefe9d0b-7a2e-4c72-addb-1b4e6328578d tempest-VolumesGetTest-107668911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-eefe9d0b-7a2e-4c72-addb-1b4e6328578d tempest-VolumesGetTest-107668911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-eefe9d0b-7a2e-4c72-addb-1b4e6328578d tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eefe9d0b-7a2e-4c72-addb-1b4e6328578d tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:53 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:22:53 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:53 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8aeab283-ac66-4209-9461-341e7fe89a0e" returned: 0 in 0.408s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.284s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-924769034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463568cf-4c61-47ac-b161-12d6e773d380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a5dbff5da74a5d993076c1ef9caa3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:51Z,use_quota=True,user_id='b67990474e7e4386b1d2bd933f0b8c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Creating volume 463568cf-4c61-47ac-b161-12d6e773d380 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:22:53 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-463568cf-4c61-47ac-b161-12d6e773d380 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a379ef4d-16db-4e1d-875c-3208b18d9a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aeab283-ac66-4209-9461-341e7fe89a0e', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4506a58-ac47-4e22-863a-b31efa08b5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:53 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-463568cf-4c61-47ac-b161-12d6e773d380 1073741824 Sep 09 18:22:53 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:53 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Volume volume-8aeab283-ac66-4209-9461-341e7fe89a0e (8aeab283-ac66-4209-9461-341e7fe89a0e): created successfully Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4506a58-ac47-4e22-863a-b31efa08b5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Flow 'volume_create_manager' (b6bd937b-dcd4-43e3-8b05-91e7ce3e38f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:53 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-71a5aedc-2cd9-4f32-9754-967326647c7d tempest-CreateVolumesFromSnapshotTest-847186939 None] Created volume successfully. Sep 09 18:22:53 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eefe9d0b-7a2e-4c72-addb-1b4e6328578d tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.501s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-eefe9d0b-7a2e-4c72-addb-1b4e6328578d tempest-VolumesGetTest-107668911 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:22:53 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-eefe9d0b-7a2e-4c72-addb-1b4e6328578d tempest-VolumesGetTest-107668911 None] Deleted volume successfully. Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-eefe9d0b-7a2e-4c72-addb-1b4e6328578d tempest-VolumesGetTest-107668911 None] Lock "cinder-31c8149b-0b2e-4c3d-a4b9-9890af3ac7ad-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-040b0f2a-72f5-4a49-99b7-f515c0bca037 tempest-VolumesGetTest-107668911 None] Acquiring lock "cinder-dc6a2b4c-2657-4915-adee-d466b480c2ec-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:53 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-040b0f2a-72f5-4a49-99b7-f515c0bca037 tempest-VolumesGetTest-107668911 None] Lock "cinder-dc6a2b4c-2657-4915-adee-d466b480c2ec-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:54 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-040b0f2a-72f5-4a49-99b7-f515c0bca037 tempest-VolumesGetTest-107668911 None] Acquiring lock "cinder-quobyte-dc6a2b4c-2657-4915-adee-d466b480c2ec" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:54 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-040b0f2a-72f5-4a49-99b7-f515c0bca037 tempest-VolumesGetTest-107668911 None] Lock "cinder-quobyte-dc6a2b4c-2657-4915-adee-d466b480c2ec" acquired by "delete_volume" :: waited 0.034s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:54 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4b917a-bec9-4a2e-9282-73c0ae34692a]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-040b0f2a-72f5-4a49-99b7-f515c0bca037 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc6a2b4c-2657-4915-adee-d466b480c2ec {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:54 devstack sudo[100614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc6a2b4c-2657-4915-adee-d466b480c2ec Sep 09 18:22:54 devstack sudo[100614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:54 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-463568cf-4c61-47ac-b161-12d6e773d380 1073741824" returned: 0 in 1.034s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-463568cf-4c61-47ac-b161-12d6e773d380 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:54 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-463568cf-4c61-47ac-b161-12d6e773d380 Sep 09 18:22:54 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:54 devstack sudo[100614]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-040b0f2a-72f5-4a49-99b7-f515c0bca037 tempest-VolumesGetTest-107668911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc6a2b4c-2657-4915-adee-d466b480c2ec" returned: 0 in 0.525s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-040b0f2a-72f5-4a49-99b7-f515c0bca037 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc6a2b4c-2657-4915-adee-d466b480c2ec {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:54 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc6a2b4c-2657-4915-adee-d466b480c2ec Sep 09 18:22:54 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:54 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-463568cf-4c61-47ac-b161-12d6e773d380" returned: 0 in 0.389s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:22:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.408s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-570678251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7c850a-98de-4b60-8496-9aa5bd715d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a5dbff5da74a5d993076c1ef9caa3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:51Z,use_quota=True,user_id='b67990474e7e4386b1d2bd933f0b8c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:22:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Creating volume 0c7c850a-98de-4b60-8496-9aa5bd715d54 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:22:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:22:54 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:22:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0c7c850a-98de-4b60-8496-9aa5bd715d54 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:54 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-040b0f2a-72f5-4a49-99b7-f515c0bca037 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc6a2b4c-2657-4915-adee-d466b480c2ec" returned: 0 in 0.367s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:55 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0c7c850a-98de-4b60-8496-9aa5bd715d54 1073741824 Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-040b0f2a-72f5-4a49-99b7-f515c0bca037 tempest-VolumesGetTest-107668911 None] Lock "cinder-quobyte-dc6a2b4c-2657-4915-adee-d466b480c2ec" released by "delete_volume" :: held 0.956s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:55 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43c941fc-3bae-4479-b38f-171818e8c00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-463568cf-4c61-47ac-b161-12d6e773d380', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (943b6f6d-bb07-460f-8798-c4a4937185b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:55 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Volume volume-463568cf-4c61-47ac-b161-12d6e773d380 (463568cf-4c61-47ac-b161-12d6e773d380): created successfully Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (943b6f6d-bb07-460f-8798-c4a4937185b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Flow 'volume_create_manager' (c2c89260-08e0-4387-a487-5612e454e80b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:55 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ab0ede07-31ab-40f6-9a2b-69be6501439c tempest-CreateVolumesFromSnapshotTest-847186939 None] Created volume successfully. Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-040b0f2a-72f5-4a49-99b7-f515c0bca037 tempest-VolumesGetTest-107668911 None] Created reservations ['fb6d1b61-4bbb-4db2-82ed-d4430f35d955', 'e2fbef97-942b-4c1a-a714-e9cfc90f8c0d', 'a8145583-0a6c-41e4-9931-eee51cfb5980', '54fd049c-0ab2-48a6-86e7-15375bcf5093'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-040b0f2a-72f5-4a49-99b7-f515c0bca037 tempest-VolumesGetTest-107668911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-040b0f2a-72f5-4a49-99b7-f515c0bca037 tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-040b0f2a-72f5-4a49-99b7-f515c0bca037 tempest-VolumesGetTest-107668911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-040b0f2a-72f5-4a49-99b7-f515c0bca037 tempest-VolumesGetTest-107668911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-040b0f2a-72f5-4a49-99b7-f515c0bca037 tempest-VolumesGetTest-107668911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-040b0f2a-72f5-4a49-99b7-f515c0bca037 tempest-VolumesGetTest-107668911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:55 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:22:55 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Flow 'volume_create_manager' (b7dc2bed-ba45-4d48-ab13-ae9d9f53a117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:55 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22de3d2d-4c25-4fa4-921f-741dba64eefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-040b0f2a-72f5-4a49-99b7-f515c0bca037 tempest-VolumesGetTest-107668911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.460s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-040b0f2a-72f5-4a49-99b7-f515c0bca037 tempest-VolumesGetTest-107668911 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:22:55 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22de3d2d-4c25-4fa4-921f-741dba64eefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-385045089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beae1b0e-6973-4879-89dd-5cf3946c5c0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7ff3a6f45bd4201bef087879917f25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:56Z,use_quota=True,user_id='c0e5f0d44dcd44d9b0fbc29fc0d9bcf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e05b147e-bcb9-4c02-b7d6-fa3e4a73e60e),volume_type_id=e05b147e-bcb9-4c02-b7d6-fa3e4a73e60e)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62bd98f3-7374-4a73-a7a8-d2144caf9696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62bd98f3-7374-4a73-a7a8-d2144caf9696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e08fab-68b7-4c07-81de-3fe8482aabd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e08fab-68b7-4c07-81de-3fe8482aabd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beae1b0e-6973-4879-89dd-5cf3946c5c0e', 'volume_name': 'volume-beae1b0e-6973-4879-89dd-5cf3946c5c0e', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6e100f-fe31-4dba-b5fc-333242be366e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd6e100f-fe31-4dba-b5fc-333242be366e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c2989f-9021-4487-8205-0fa2d5d6b0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:55 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Volume beae1b0e-6973-4879-89dd-5cf3946c5c0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beae1b0e-6973-4879-89dd-5cf3946c5c0e', 'volume_size': 1} Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:55 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-040b0f2a-72f5-4a49-99b7-f515c0bca037 tempest-VolumesGetTest-107668911 None] Deleted volume successfully. Sep 09 18:22:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0c7c850a-98de-4b60-8496-9aa5bd715d54 1073741824" returned: 0 in 1.020s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:56 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-040b0f2a-72f5-4a49-99b7-f515c0bca037 tempest-VolumesGetTest-107668911 None] Lock "cinder-dc6a2b4c-2657-4915-adee-d466b480c2ec-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0c7c850a-98de-4b60-8496-9aa5bd715d54 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:56 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0c7c850a-98de-4b60-8496-9aa5bd715d54 Sep 09 18:22:56 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:56 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0c7c850a-98de-4b60-8496-9aa5bd715d54" returned: 0 in 0.324s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:22:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.774s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2132591793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a5dbff5da74a5d993076c1ef9caa3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:52Z,use_quota=True,user_id='b67990474e7e4386b1d2bd933f0b8c47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:22:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Creating volume a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:22:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:22:56 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:22:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:56 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e503a4c7-4891-440d-845a-695fc6cc557c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c7c850a-98de-4b60-8496-9aa5bd715d54', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:56 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef1b7ad7-22c6-4538-b857-d3388bd124a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:56 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b 1073741824 Sep 09 18:22:56 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:56 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Volume volume-0c7c850a-98de-4b60-8496-9aa5bd715d54 (0c7c850a-98de-4b60-8496-9aa5bd715d54): created successfully Sep 09 18:22:56 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef1b7ad7-22c6-4538-b857-d3388bd124a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:56 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Flow 'volume_create_manager' (91d2c10a-f1bc-40ad-b383-c70790251caf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:56 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-5724c1e7-d713-4297-bb69-ecce6b170f8d tempest-CreateVolumesFromSnapshotTest-847186939 None] Created volume successfully. Sep 09 18:22:57 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b 1073741824" returned: 0 in 0.915s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:57 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b Sep 09 18:22:57 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:57 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b" returned: 0 in 0.324s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:22:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.724s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-385045089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beae1b0e-6973-4879-89dd-5cf3946c5c0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7ff3a6f45bd4201bef087879917f25e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:22:56Z,use_quota=True,user_id='c0e5f0d44dcd44d9b0fbc29fc0d9bcf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e05b147e-bcb9-4c02-b7d6-fa3e4a73e60e),volume_type_id=e05b147e-bcb9-4c02-b7d6-fa3e4a73e60e)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:22:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Creating volume beae1b0e-6973-4879-89dd-5cf3946c5c0e {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:22:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:22:57 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:22:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-beae1b0e-6973-4879-89dd-5cf3946c5c0e 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc2d80f-c7f2-4e65-954c-2dc74c13a461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:57 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-beae1b0e-6973-4879-89dd-5cf3946c5c0e 1073741824 Sep 09 18:22:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de6d0b6-8024-4182-a0e5-ba36cba31bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:57 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:57 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Volume volume-a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b (a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b): created successfully Sep 09 18:22:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de6d0b6-8024-4182-a0e5-ba36cba31bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Flow 'volume_create_manager' (fbb0efd0-2888-41ee-96f5-342576492d3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:57 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-08b5b73a-6a5d-459b-a037-a716d4d49c27 tempest-CreateVolumesFromSnapshotTest-847186939 None] Created volume successfully. Sep 09 18:22:58 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8f5e826a-37d7-4671-b43d-c2d7e1969152 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "cinder-a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:58 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8f5e826a-37d7-4671-b43d-c2d7e1969152 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:58 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8f5e826a-37d7-4671-b43d-c2d7e1969152 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "cinder-quobyte-a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:22:58 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8f5e826a-37d7-4671-b43d-c2d7e1969152 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-quobyte-a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b" acquired by "delete_volume" :: waited 0.024s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:22:58 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[851579da-9a74-48bf-9151-2bd40b9833c5]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:22:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8f5e826a-37d7-4671-b43d-c2d7e1969152 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:58 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-beae1b0e-6973-4879-89dd-5cf3946c5c0e 1073741824" returned: 0 in 0.810s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-beae1b0e-6973-4879-89dd-5cf3946c5c0e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:58 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-beae1b0e-6973-4879-89dd-5cf3946c5c0e Sep 09 18:22:58 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:58 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b Sep 09 18:22:58 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:59 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-beae1b0e-6973-4879-89dd-5cf3946c5c0e" returned: 0 in 0.533s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:59 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:22:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c2989f-9021-4487-8205-0fa2d5d6b0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beae1b0e-6973-4879-89dd-5cf3946c5c0e', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2279b9d2-3aaa-4ad5-bfbe-75d754688b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:22:59 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Volume volume-beae1b0e-6973-4879-89dd-5cf3946c5c0e (beae1b0e-6973-4879-89dd-5cf3946c5c0e): created successfully Sep 09 18:22:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2279b9d2-3aaa-4ad5-bfbe-75d754688b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:22:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Flow 'volume_create_manager' (b7dc2bed-ba45-4d48-ab13-ae9d9f53a117) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:22:59 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-86990b27-391e-4e42-a208-7d29f658d447 tempest-VolumeTypesAccessTest-1268627314 None] Created volume successfully. Sep 09 18:22:59 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8f5e826a-37d7-4671-b43d-c2d7e1969152 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b" returned: 0 in 0.769s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8f5e826a-37d7-4671-b43d-c2d7e1969152 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:59 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b Sep 09 18:22:59 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:22:59 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Sep 09 18:22:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8f5e826a-37d7-4671-b43d-c2d7e1969152 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b" returned: 0 in 0.422s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:22:59 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8f5e826a-37d7-4671-b43d-c2d7e1969152 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-quobyte-a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b" released by "delete_volume" :: held 1.262s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:22:59 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-8f5e826a-37d7-4671-b43d-c2d7e1969152 tempest-CreateVolumesFromSnapshotTest-847186939 None] Created reservations ['92ae6b47-b300-4ec1-9c4d-6ae228762fcb', '2ab2f4fa-d843-4ba7-aac3-e77a7af4a39d', '9a49ab9f-052e-4607-a771-d614b9cacd7d', '7be2e3df-8360-4e74-84d1-ba5f9b381225'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:22:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8f5e826a-37d7-4671-b43d-c2d7e1969152 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:22:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8f5e826a-37d7-4671-b43d-c2d7e1969152 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:22:59 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8f5e826a-37d7-4671-b43d-c2d7e1969152 tempest-CreateVolumesFromSnapshotTest-847186939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:22:59 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8f5e826a-37d7-4671-b43d-c2d7e1969152 tempest-CreateVolumesFromSnapshotTest-847186939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:22:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8f5e826a-37d7-4671-b43d-c2d7e1969152 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:22:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8f5e826a-37d7-4671-b43d-c2d7e1969152 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:22:59 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:22:59 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:00 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8f5e826a-37d7-4671-b43d-c2d7e1969152 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.466s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:00 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-8f5e826a-37d7-4671-b43d-c2d7e1969152 tempest-CreateVolumesFromSnapshotTest-847186939 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:00 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-8f5e826a-37d7-4671-b43d-c2d7e1969152 tempest-CreateVolumesFromSnapshotTest-847186939 None] Deleted volume successfully. Sep 09 18:23:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8f5e826a-37d7-4671-b43d-c2d7e1969152 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-a6e5d2da-ceb7-4934-ba9b-e89dd9d5214b-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9b9da929-3165-4f52-bd94-4315c6502caf tempest-VolumeTypesAccessTest-1268627314 None] Acquiring lock "cinder-beae1b0e-6973-4879-89dd-5cf3946c5c0e-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9b9da929-3165-4f52-bd94-4315c6502caf tempest-VolumeTypesAccessTest-1268627314 None] Lock "cinder-beae1b0e-6973-4879-89dd-5cf3946c5c0e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9b9da929-3165-4f52-bd94-4315c6502caf tempest-VolumeTypesAccessTest-1268627314 None] Acquiring lock "cinder-quobyte-beae1b0e-6973-4879-89dd-5cf3946c5c0e" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9b9da929-3165-4f52-bd94-4315c6502caf tempest-VolumeTypesAccessTest-1268627314 None] Lock "cinder-quobyte-beae1b0e-6973-4879-89dd-5cf3946c5c0e" acquired by "delete_volume" :: waited 0.040s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:00 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd2fb40-0a98-41a5-afac-30506da530bd]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9b9da929-3165-4f52-bd94-4315c6502caf tempest-VolumeTypesAccessTest-1268627314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-beae1b0e-6973-4879-89dd-5cf3946c5c0e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e93ae41e-397e-4ba6-aa8e-c575833f4be1 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "cinder-0c7c850a-98de-4b60-8496-9aa5bd715d54-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e93ae41e-397e-4ba6-aa8e-c575833f4be1 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-0c7c850a-98de-4b60-8496-9aa5bd715d54-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:00 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-beae1b0e-6973-4879-89dd-5cf3946c5c0e Sep 09 18:23:00 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e93ae41e-397e-4ba6-aa8e-c575833f4be1 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "cinder-quobyte-0c7c850a-98de-4b60-8496-9aa5bd715d54" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e93ae41e-397e-4ba6-aa8e-c575833f4be1 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-quobyte-0c7c850a-98de-4b60-8496-9aa5bd715d54" acquired by "delete_volume" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:00 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[25849c00-5455-461d-8301-cbea4f9cdb59]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e93ae41e-397e-4ba6-aa8e-c575833f4be1 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0c7c850a-98de-4b60-8496-9aa5bd715d54 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:01 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0c7c850a-98de-4b60-8496-9aa5bd715d54 Sep 09 18:23:01 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:01 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9b9da929-3165-4f52-bd94-4315c6502caf tempest-VolumeTypesAccessTest-1268627314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-beae1b0e-6973-4879-89dd-5cf3946c5c0e" returned: 0 in 0.620s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9b9da929-3165-4f52-bd94-4315c6502caf tempest-VolumeTypesAccessTest-1268627314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-beae1b0e-6973-4879-89dd-5cf3946c5c0e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:01 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-beae1b0e-6973-4879-89dd-5cf3946c5c0e Sep 09 18:23:01 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:01 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e93ae41e-397e-4ba6-aa8e-c575833f4be1 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0c7c850a-98de-4b60-8496-9aa5bd715d54" returned: 0 in 0.752s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e93ae41e-397e-4ba6-aa8e-c575833f4be1 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0c7c850a-98de-4b60-8496-9aa5bd715d54 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:01 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0c7c850a-98de-4b60-8496-9aa5bd715d54 Sep 09 18:23:01 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:01 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9b9da929-3165-4f52-bd94-4315c6502caf tempest-VolumeTypesAccessTest-1268627314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-beae1b0e-6973-4879-89dd-5cf3946c5c0e" returned: 0 in 0.647s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:01 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9b9da929-3165-4f52-bd94-4315c6502caf tempest-VolumeTypesAccessTest-1268627314 None] Lock "cinder-quobyte-beae1b0e-6973-4879-89dd-5cf3946c5c0e" released by "delete_volume" :: held 1.340s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:01 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e93ae41e-397e-4ba6-aa8e-c575833f4be1 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0c7c850a-98de-4b60-8496-9aa5bd715d54" returned: 0 in 0.354s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:01 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e93ae41e-397e-4ba6-aa8e-c575833f4be1 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-quobyte-0c7c850a-98de-4b60-8496-9aa5bd715d54" released by "delete_volume" :: held 1.176s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:01 devstack cinder-volume[87639]: WARNING cinder.quota [None req-9b9da929-3165-4f52-bd94-4315c6502caf tempest-VolumeTypesAccessTest-1268627314 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-439428172 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-439428172, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:23:01 devstack cinder-volume[87639]: WARNING cinder.quota [None req-9b9da929-3165-4f52-bd94-4315c6502caf tempest-VolumeTypesAccessTest-1268627314 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-439428172 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-439428172, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:23:01 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-9b9da929-3165-4f52-bd94-4315c6502caf tempest-VolumeTypesAccessTest-1268627314 None] Created reservations ['2ed29c10-b6d6-48ab-8d7d-04c58cb06019', '3559be8b-a06a-450c-b0dd-f974cae44ba0', 'eb3caa5b-d832-43ec-bc16-a1b01c96e9e2', 'b7694ac3-a900-476b-bcc9-bb34e3311e1b'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:02 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-e93ae41e-397e-4ba6-aa8e-c575833f4be1 tempest-CreateVolumesFromSnapshotTest-847186939 None] Created reservations ['5eb2cebb-a6bc-4e06-92b1-19e87a2c2204', '3a534e08-b812-45a5-86f4-f05bd1f02ee2', '430f07e0-db4e-4407-9698-ee588e516270', 'dfd1d7c9-bd38-478c-9f21-30dc04df1e87'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9b9da929-3165-4f52-bd94-4315c6502caf tempest-VolumeTypesAccessTest-1268627314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9b9da929-3165-4f52-bd94-4315c6502caf tempest-VolumeTypesAccessTest-1268627314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-9b9da929-3165-4f52-bd94-4315c6502caf tempest-VolumeTypesAccessTest-1268627314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-9b9da929-3165-4f52-bd94-4315c6502caf tempest-VolumeTypesAccessTest-1268627314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9b9da929-3165-4f52-bd94-4315c6502caf tempest-VolumeTypesAccessTest-1268627314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9b9da929-3165-4f52-bd94-4315c6502caf tempest-VolumeTypesAccessTest-1268627314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:02 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:23:02 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e93ae41e-397e-4ba6-aa8e-c575833f4be1 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e93ae41e-397e-4ba6-aa8e-c575833f4be1 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e93ae41e-397e-4ba6-aa8e-c575833f4be1 tempest-CreateVolumesFromSnapshotTest-847186939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e93ae41e-397e-4ba6-aa8e-c575833f4be1 tempest-CreateVolumesFromSnapshotTest-847186939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e93ae41e-397e-4ba6-aa8e-c575833f4be1 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e93ae41e-397e-4ba6-aa8e-c575833f4be1 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:02 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:23:02 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:02 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9b9da929-3165-4f52-bd94-4315c6502caf tempest-VolumeTypesAccessTest-1268627314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.356s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:02 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-9b9da929-3165-4f52-bd94-4315c6502caf tempest-VolumeTypesAccessTest-1268627314 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:02 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-9b9da929-3165-4f52-bd94-4315c6502caf tempest-VolumeTypesAccessTest-1268627314 None] Deleted volume successfully. Sep 09 18:23:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9b9da929-3165-4f52-bd94-4315c6502caf tempest-VolumeTypesAccessTest-1268627314 None] Lock "cinder-beae1b0e-6973-4879-89dd-5cf3946c5c0e-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:02 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e93ae41e-397e-4ba6-aa8e-c575833f4be1 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.362s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:02 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-e93ae41e-397e-4ba6-aa8e-c575833f4be1 tempest-CreateVolumesFromSnapshotTest-847186939 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:02 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-e93ae41e-397e-4ba6-aa8e-c575833f4be1 tempest-CreateVolumesFromSnapshotTest-847186939 None] Deleted volume successfully. Sep 09 18:23:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e93ae41e-397e-4ba6-aa8e-c575833f4be1 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-0c7c850a-98de-4b60-8496-9aa5bd715d54-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-53cd959d-3a8e-4287-8f6e-aee2795cb704 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "cinder-463568cf-4c61-47ac-b161-12d6e773d380-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-53cd959d-3a8e-4287-8f6e-aee2795cb704 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-463568cf-4c61-47ac-b161-12d6e773d380-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-53cd959d-3a8e-4287-8f6e-aee2795cb704 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "cinder-quobyte-463568cf-4c61-47ac-b161-12d6e773d380" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Flow 'volume_create_manager' (c52b6ec4-1e36-4830-a344-f15e78788418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca25396-ac63-49d9-82c4-1376c0b4b5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-53cd959d-3a8e-4287-8f6e-aee2795cb704 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-quobyte-463568cf-4c61-47ac-b161-12d6e773d380" acquired by "delete_volume" :: waited 0.064s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca25396-ac63-49d9-82c4-1376c0b4b5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1413740595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c97813-9a24-425b-ab69-3fe7af900cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='619179f8bcac4b0f8d3bdeba8ddc8aed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:03Z,use_quota=True,user_id='83b5d76085b24ce3be9c0230cf0d6ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f574153-2d3e-42b3-94f8-9c49be67a987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f574153-2d3e-42b3-94f8-9c49be67a987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c995e83-a5fd-4eeb-a852-f85c663a946b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c995e83-a5fd-4eeb-a852-f85c663a946b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4c97813-9a24-425b-ab69-3fe7af900cac', 'volume_name': 'volume-e4c97813-9a24-425b-ab69-3fe7af900cac', 'volume_size': 2}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b625dd3c-7325-4868-985b-34474b71236e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b625dd3c-7325-4868-985b-34474b71236e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e8f2db-dea6-4e40-9b15-cc8185256c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:03 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Volume e4c97813-9a24-425b-ab69-3fe7af900cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4c97813-9a24-425b-ab69-3fe7af900cac', 'volume_size': 2} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1413740595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c97813-9a24-425b-ab69-3fe7af900cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='619179f8bcac4b0f8d3bdeba8ddc8aed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:03Z,use_quota=True,user_id='83b5d76085b24ce3be9c0230cf0d6ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Creating volume e4c97813-9a24-425b-ab69-3fe7af900cac {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:23:03 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac 2147483648 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e6e291-d435-495b-b2bc-87a5de83dbd7]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-53cd959d-3a8e-4287-8f6e-aee2795cb704 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-463568cf-4c61-47ac-b161-12d6e773d380 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:03 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac 2147483648 Sep 09 18:23:03 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:03 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-463568cf-4c61-47ac-b161-12d6e773d380 Sep 09 18:23:03 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:04 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-53cd959d-3a8e-4287-8f6e-aee2795cb704 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-463568cf-4c61-47ac-b161-12d6e773d380" returned: 0 in 0.701s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-53cd959d-3a8e-4287-8f6e-aee2795cb704 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-463568cf-4c61-47ac-b161-12d6e773d380 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:04 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-463568cf-4c61-47ac-b161-12d6e773d380 Sep 09 18:23:04 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:04 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac 2147483648" returned: 0 in 0.838s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:04 devstack sudo[100745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac Sep 09 18:23:04 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:04 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-53cd959d-3a8e-4287-8f6e-aee2795cb704 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-463568cf-4c61-47ac-b161-12d6e773d380" returned: 0 in 0.393s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-53cd959d-3a8e-4287-8f6e-aee2795cb704 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-quobyte-463568cf-4c61-47ac-b161-12d6e773d380" released by "delete_volume" :: held 1.215s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:04 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac" returned: 0 in 0.310s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:04 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:23:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:04 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e8f2db-dea6-4e40-9b15-cc8185256c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4c97813-9a24-425b-ab69-3fe7af900cac', 'volume_size': 2}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:04 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2191652c-0c15-4ebb-b805-83505d744efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:04 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-53cd959d-3a8e-4287-8f6e-aee2795cb704 tempest-CreateVolumesFromSnapshotTest-847186939 None] Created reservations ['7e368260-5e6f-4635-8b0e-ff62cc5d7423', '20414502-a15f-4589-8d86-2e4a3032ec30', '2a51b952-89f3-4ec6-94ce-366cc02d2d13', '30b9f4d0-310f-48c8-82a0-26e125887f70'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:04 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Volume volume-e4c97813-9a24-425b-ab69-3fe7af900cac (e4c97813-9a24-425b-ab69-3fe7af900cac): created successfully Sep 09 18:23:04 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2191652c-0c15-4ebb-b805-83505d744efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:04 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Flow 'volume_create_manager' (c52b6ec4-1e36-4830-a344-f15e78788418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:04 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-0a7df5ee-9cf7-47a3-aaa6-499401a82941 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Created volume successfully. Sep 09 18:23:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-53cd959d-3a8e-4287-8f6e-aee2795cb704 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-53cd959d-3a8e-4287-8f6e-aee2795cb704 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:04 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-53cd959d-3a8e-4287-8f6e-aee2795cb704 tempest-CreateVolumesFromSnapshotTest-847186939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:04 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-53cd959d-3a8e-4287-8f6e-aee2795cb704 tempest-CreateVolumesFromSnapshotTest-847186939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-53cd959d-3a8e-4287-8f6e-aee2795cb704 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-53cd959d-3a8e-4287-8f6e-aee2795cb704 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:04 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:23:04 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:04 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-53cd959d-3a8e-4287-8f6e-aee2795cb704 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.286s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:04 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-53cd959d-3a8e-4287-8f6e-aee2795cb704 tempest-CreateVolumesFromSnapshotTest-847186939 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:04 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-53cd959d-3a8e-4287-8f6e-aee2795cb704 tempest-CreateVolumesFromSnapshotTest-847186939 None] Deleted volume successfully. Sep 09 18:23:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-53cd959d-3a8e-4287-8f6e-aee2795cb704 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-463568cf-4c61-47ac-b161-12d6e773d380-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ee474bcb-c49f-4a45-8741-769a3e7dee26 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "cinder-8aeab283-ac66-4209-9461-341e7fe89a0e-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ee474bcb-c49f-4a45-8741-769a3e7dee26 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-8aeab283-ac66-4209-9461-341e7fe89a0e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:05 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=136,cinder:INSERT=48,cinder:UPDATE=175,cinder:DELETE=19 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:23:05 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=135,cinder:INSERT=53,cinder:UPDATE=184,cinder:DELETE=16 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:23:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ee474bcb-c49f-4a45-8741-769a3e7dee26 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "cinder-quobyte-8aeab283-ac66-4209-9461-341e7fe89a0e" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ee474bcb-c49f-4a45-8741-769a3e7dee26 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-quobyte-8aeab283-ac66-4209-9461-341e7fe89a0e" acquired by "delete_volume" :: waited 0.062s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:05 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aff41fe-20cc-4838-be57-2b3619e521ab]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ee474bcb-c49f-4a45-8741-769a3e7dee26 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8aeab283-ac66-4209-9461-341e7fe89a0e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4a8d4e6c-3337-4656-9681-f391ff2b6a5d tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4a8d4e6c-3337-4656-9681-f391ff2b6a5d tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:05 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-4a8d4e6c-3337-4656-9681-f391ff2b6a5d tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Creating offline snapshot 3d1d7de3-cc6e-4b67-866c-87eec64e946e of volume e4c97813-9a24-425b-ab69-3fe7af900cac {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:23:05 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f21581-0673-47a5-879c-f39dc4dd4227]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a8d4e6c-3337-4656-9681-f391ff2b6a5d tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:05 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8aeab283-ac66-4209-9461-341e7fe89a0e Sep 09 18:23:05 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:05 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac Sep 09 18:23:05 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:06 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ee474bcb-c49f-4a45-8741-769a3e7dee26 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8aeab283-ac66-4209-9461-341e7fe89a0e" returned: 0 in 0.484s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ee474bcb-c49f-4a45-8741-769a3e7dee26 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8aeab283-ac66-4209-9461-341e7fe89a0e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:06 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8aeab283-ac66-4209-9461-341e7fe89a0e Sep 09 18:23:06 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:06 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a8d4e6c-3337-4656-9681-f391ff2b6a5d tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac" returned: 0 in 0.510s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a8d4e6c-3337-4656-9681-f391ff2b6a5d tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.3d1d7de3-cc6e-4b67-866c-87eec64e946e 2G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:06 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.3d1d7de3-cc6e-4b67-866c-87eec64e946e 2G Sep 09 18:23:06 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:06 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ee474bcb-c49f-4a45-8741-769a3e7dee26 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8aeab283-ac66-4209-9461-341e7fe89a0e" returned: 0 in 0.303s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ee474bcb-c49f-4a45-8741-769a3e7dee26 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-quobyte-8aeab283-ac66-4209-9461-341e7fe89a0e" released by "delete_volume" :: held 0.838s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-ee474bcb-c49f-4a45-8741-769a3e7dee26 tempest-CreateVolumesFromSnapshotTest-847186939 None] Created reservations ['a4cbd73d-c854-446d-aac9-bece33ef81d9', '84cb906e-5391-425f-a6ea-88c960829ea7', 'bbe0511d-fc6b-401d-8d38-a668b88a2354', '8102a22b-745d-4021-843e-8b9082e0803e'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ee474bcb-c49f-4a45-8741-769a3e7dee26 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ee474bcb-c49f-4a45-8741-769a3e7dee26 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ee474bcb-c49f-4a45-8741-769a3e7dee26 tempest-CreateVolumesFromSnapshotTest-847186939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ee474bcb-c49f-4a45-8741-769a3e7dee26 tempest-CreateVolumesFromSnapshotTest-847186939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ee474bcb-c49f-4a45-8741-769a3e7dee26 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ee474bcb-c49f-4a45-8741-769a3e7dee26 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:06 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:23:06 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-74051f5e-6625-4573-9236-17028d659202 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "cinder-0353972b-fd8b-42c6-8c43-7e668beaffa1-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-74051f5e-6625-4573-9236-17028d659202 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-0353972b-fd8b-42c6-8c43-7e668beaffa1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-74051f5e-6625-4573-9236-17028d659202 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "cinder-quobyte-0353972b-fd8b-42c6-8c43-7e668beaffa1" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-74051f5e-6625-4573-9236-17028d659202 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-quobyte-0353972b-fd8b-42c6-8c43-7e668beaffa1" acquired by "delete_volume" :: waited 0.037s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa668ce3-66d9-42f9-9235-62c3607e866f]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74051f5e-6625-4573-9236-17028d659202 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0353972b-fd8b-42c6-8c43-7e668beaffa1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:06 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ee474bcb-c49f-4a45-8741-769a3e7dee26 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.342s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-ee474bcb-c49f-4a45-8741-769a3e7dee26 tempest-CreateVolumesFromSnapshotTest-847186939 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:06 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ee474bcb-c49f-4a45-8741-769a3e7dee26 tempest-CreateVolumesFromSnapshotTest-847186939 None] Deleted volume successfully. Sep 09 18:23:06 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a8d4e6c-3337-4656-9681-f391ff2b6a5d tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.3d1d7de3-cc6e-4b67-866c-87eec64e946e 2G" returned: 0 in 0.722s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a8d4e6c-3337-4656-9681-f391ff2b6a5d tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c97813-9a24-425b-ab69-3fe7af900cac -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.3d1d7de3-cc6e-4b67-866c-87eec64e946e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:07 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ee474bcb-c49f-4a45-8741-769a3e7dee26 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-8aeab283-ac66-4209-9461-341e7fe89a0e-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:07 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c97813-9a24-425b-ab69-3fe7af900cac -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.3d1d7de3-cc6e-4b67-866c-87eec64e946e Sep 09 18:23:07 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:07 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0353972b-fd8b-42c6-8c43-7e668beaffa1 Sep 09 18:23:07 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:07 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74051f5e-6625-4573-9236-17028d659202 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0353972b-fd8b-42c6-8c43-7e668beaffa1" returned: 0 in 0.492s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74051f5e-6625-4573-9236-17028d659202 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0353972b-fd8b-42c6-8c43-7e668beaffa1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:07 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a8d4e6c-3337-4656-9681-f391ff2b6a5d tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4c97813-9a24-425b-ab69-3fe7af900cac -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.3d1d7de3-cc6e-4b67-866c-87eec64e946e" returned: 0 in 0.440s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:07 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-4a8d4e6c-3337-4656-9681-f391ff2b6a5d tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.3d1d7de3-cc6e-4b67-866c-87eec64e946e is being set with open permissions: ugo+rw Sep 09 18:23:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a8d4e6c-3337-4656-9681-f391ff2b6a5d tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.3d1d7de3-cc6e-4b67-866c-87eec64e946e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:07 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0353972b-fd8b-42c6-8c43-7e668beaffa1 Sep 09 18:23:07 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:07 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.3d1d7de3-cc6e-4b67-866c-87eec64e946e Sep 09 18:23:07 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:07 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a8d4e6c-3337-4656-9681-f391ff2b6a5d tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.3d1d7de3-cc6e-4b67-866c-87eec64e946e" returned: 0 in 0.331s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:07 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74051f5e-6625-4573-9236-17028d659202 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0353972b-fd8b-42c6-8c43-7e668beaffa1" returned: 0 in 0.371s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:07 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-74051f5e-6625-4573-9236-17028d659202 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-quobyte-0353972b-fd8b-42c6-8c43-7e668beaffa1" released by "delete_volume" :: held 0.920s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a8d4e6c-3337-4656-9681-f391ff2b6a5d tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:07 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.info Sep 09 18:23:07 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:07 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-74051f5e-6625-4573-9236-17028d659202 tempest-CreateVolumesFromSnapshotTest-847186939 None] Created reservations ['6e95be4f-936d-44c6-b351-f09065b75087', '3cb2310e-b3b0-4ac2-b213-78e1c0613933', 'f66145da-5910-4cd8-bc8a-19683319faba', '8430976f-12bf-48b4-8fdf-f00081f384df'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-74051f5e-6625-4573-9236-17028d659202 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-74051f5e-6625-4573-9236-17028d659202 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-74051f5e-6625-4573-9236-17028d659202 tempest-CreateVolumesFromSnapshotTest-847186939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-74051f5e-6625-4573-9236-17028d659202 tempest-CreateVolumesFromSnapshotTest-847186939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-74051f5e-6625-4573-9236-17028d659202 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74051f5e-6625-4573-9236-17028d659202 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:08 devstack sudo[100830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:23:08 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:08 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a8d4e6c-3337-4656-9681-f391ff2b6a5d tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.info" returned: 0 in 0.347s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:08 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-4a8d4e6c-3337-4656-9681-f391ff2b6a5d tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.info is being set with open permissions: ugo+rw Sep 09 18:23:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a8d4e6c-3337-4656-9681-f391ff2b6a5d tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:08 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.info Sep 09 18:23:08 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:08 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74051f5e-6625-4573-9236-17028d659202 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.339s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:08 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-74051f5e-6625-4573-9236-17028d659202 tempest-CreateVolumesFromSnapshotTest-847186939 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:08 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-74051f5e-6625-4573-9236-17028d659202 tempest-CreateVolumesFromSnapshotTest-847186939 None] Deleted volume successfully. Sep 09 18:23:08 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-74051f5e-6625-4573-9236-17028d659202 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-0353972b-fd8b-42c6-8c43-7e668beaffa1-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:08 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a8d4e6c-3337-4656-9681-f391ff2b6a5d tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.info" returned: 0 in 0.304s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4a8d4e6c-3337-4656-9681-f391ff2b6a5d tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.771s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:08 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-4a8d4e6c-3337-4656-9681-f391ff2b6a5d tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Create snapshot completed successfully Sep 09 18:23:08 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d0d19cdf-cfb0-4346-8925-ccdd6b2e69ae tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Acquiring lock "cinder-3d1d7de3-cc6e-4b67-866c-87eec64e946e-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:08 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d0d19cdf-cfb0-4346-8925-ccdd6b2e69ae tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Lock "cinder-3d1d7de3-cc6e-4b67-866c-87eec64e946e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:08 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d0d19cdf-cfb0-4346-8925-ccdd6b2e69ae tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Acquiring lock "cinder-quobyte-e4c97813-9a24-425b-ab69-3fe7af900cac" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d0d19cdf-cfb0-4346-8925-ccdd6b2e69ae tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Lock "cinder-quobyte-e4c97813-9a24-425b-ab69-3fe7af900cac" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d0d19cdf-cfb0-4346-8925-ccdd6b2e69ae tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Acquiring lock "cinder-quobyte-3d1d7de3-cc6e-4b67-866c-87eec64e946e" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d0d19cdf-cfb0-4346-8925-ccdd6b2e69ae tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Lock "cinder-quobyte-3d1d7de3-cc6e-4b67-866c-87eec64e946e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-d0d19cdf-cfb0-4346-8925-ccdd6b2e69ae tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Deleting offline snapshot 3d1d7de3-cc6e-4b67-866c-87eec64e946e of volume e4c97813-9a24-425b-ab69-3fe7af900cac {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-d0d19cdf-cfb0-4346-8925-ccdd6b2e69ae tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] snapshot_file for this snap is: volume-e4c97813-9a24-425b-ab69-3fe7af900cac.3d1d7de3-cc6e-4b67-866c-87eec64e946e {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ea3676d2-a625-4cf3-aad6-18451070634d tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "cinder-71eb9621-3695-4edf-916c-6bb411853cfc-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa272ff-ba8a-40df-9c99-47c631ae9130]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d0d19cdf-cfb0-4346-8925-ccdd6b2e69ae tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.3d1d7de3-cc6e-4b67-866c-87eec64e946e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ea3676d2-a625-4cf3-aad6-18451070634d tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-71eb9621-3695-4edf-916c-6bb411853cfc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ea3676d2-a625-4cf3-aad6-18451070634d tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "cinder-quobyte-09c6947f-ab06-48c2-9e20-16c62f44a46c" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ea3676d2-a625-4cf3-aad6-18451070634d tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-quobyte-09c6947f-ab06-48c2-9e20-16c62f44a46c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ea3676d2-a625-4cf3-aad6-18451070634d tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "cinder-quobyte-71eb9621-3695-4edf-916c-6bb411853cfc" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ea3676d2-a625-4cf3-aad6-18451070634d tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-quobyte-71eb9621-3695-4edf-916c-6bb411853cfc" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-ea3676d2-a625-4cf3-aad6-18451070634d tempest-CreateVolumesFromSnapshotTest-847186939 None] Deleting offline snapshot 71eb9621-3695-4edf-916c-6bb411853cfc of volume 09c6947f-ab06-48c2-9e20-16c62f44a46c {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-ea3676d2-a625-4cf3-aad6-18451070634d tempest-CreateVolumesFromSnapshotTest-847186939 None] snapshot_file for this snap is: volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.71eb9621-3695-4edf-916c-6bb411853cfc {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[294287e9-4bef-49d9-a4c9-e8c11f15b426]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ea3676d2-a625-4cf3-aad6-18451070634d tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.71eb9621-3695-4edf-916c-6bb411853cfc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:09 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.3d1d7de3-cc6e-4b67-866c-87eec64e946e Sep 09 18:23:09 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:09 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.71eb9621-3695-4edf-916c-6bb411853cfc Sep 09 18:23:09 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:09 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d0d19cdf-cfb0-4346-8925-ccdd6b2e69ae tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.3d1d7de3-cc6e-4b67-866c-87eec64e946e" returned: 0 in 0.425s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-d0d19cdf-cfb0-4346-8925-ccdd6b2e69ae tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4c97813-9a24-425b-ab69-3fe7af900cac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[31df4e7c-9627-4bc8-929a-a26bb6a03096]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d0d19cdf-cfb0-4346-8925-ccdd6b2e69ae tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:09 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ea3676d2-a625-4cf3-aad6-18451070634d tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.71eb9621-3695-4edf-916c-6bb411853cfc" returned: 0 in 0.427s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-ea3676d2-a625-4cf3-aad6-18451070634d tempest-CreateVolumesFromSnapshotTest-847186939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09c6947f-ab06-48c2-9e20-16c62f44a46c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b95bc09-0763-4c3c-a3fa-5dd4a25152e5]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ea3676d2-a625-4cf3-aad6-18451070634d tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:09 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac Sep 09 18:23:09 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:09 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c Sep 09 18:23:09 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:09 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d0d19cdf-cfb0-4346-8925-ccdd6b2e69ae tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac" returned: 0 in 0.389s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d0d19cdf-cfb0-4346-8925-ccdd6b2e69ae tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.3d1d7de3-cc6e-4b67-866c-87eec64e946e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:09 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.3d1d7de3-cc6e-4b67-866c-87eec64e946e Sep 09 18:23:09 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:10 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ea3676d2-a625-4cf3-aad6-18451070634d tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c" returned: 0 in 0.440s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ea3676d2-a625-4cf3-aad6-18451070634d tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.71eb9621-3695-4edf-916c-6bb411853cfc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:10 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.71eb9621-3695-4edf-916c-6bb411853cfc Sep 09 18:23:10 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:10 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d0d19cdf-cfb0-4346-8925-ccdd6b2e69ae tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.3d1d7de3-cc6e-4b67-866c-87eec64e946e" returned: 0 in 0.364s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d0d19cdf-cfb0-4346-8925-ccdd6b2e69ae tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.3d1d7de3-cc6e-4b67-866c-87eec64e946e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:10 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.3d1d7de3-cc6e-4b67-866c-87eec64e946e Sep 09 18:23:10 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:10 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ea3676d2-a625-4cf3-aad6-18451070634d tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.71eb9621-3695-4edf-916c-6bb411853cfc" returned: 0 in 0.423s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ea3676d2-a625-4cf3-aad6-18451070634d tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.71eb9621-3695-4edf-916c-6bb411853cfc {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:10 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.71eb9621-3695-4edf-916c-6bb411853cfc Sep 09 18:23:10 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:10 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d0d19cdf-cfb0-4346-8925-ccdd6b2e69ae tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac.3d1d7de3-cc6e-4b67-866c-87eec64e946e" returned: 0 in 0.299s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:10 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d0d19cdf-cfb0-4346-8925-ccdd6b2e69ae tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Lock "cinder-quobyte-3d1d7de3-cc6e-4b67-866c-87eec64e946e" released by "_delete_snapshot" :: held 1.612s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:10 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d0d19cdf-cfb0-4346-8925-ccdd6b2e69ae tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Lock "cinder-quobyte-e4c97813-9a24-425b-ab69-3fe7af900cac" released by "delete_snapshot" :: held 1.643s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:10 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-d0d19cdf-cfb0-4346-8925-ccdd6b2e69ae tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Created reservations ['4d9c94f1-ccb1-4948-b91b-7e38ea1a477a', '32de938b-8b20-40f7-89bd-4ff0b7ab027f', '2e601857-a9ff-4ce7-86a6-03ff76d803fa', 'f3befd02-de9c-48e3-812d-60911fcb9f26'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:10 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d0d19cdf-cfb0-4346-8925-ccdd6b2e69ae tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Delete snapshot completed successfully. Sep 09 18:23:10 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:10 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d0d19cdf-cfb0-4346-8925-ccdd6b2e69ae tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Lock "cinder-3d1d7de3-cc6e-4b67-866c-87eec64e946e-delete_snapshot" released by "delete_snapshot" :: held 1.828s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ea3676d2-a625-4cf3-aad6-18451070634d tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c.71eb9621-3695-4edf-916c-6bb411853cfc" returned: 0 in 0.284s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:10 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ea3676d2-a625-4cf3-aad6-18451070634d tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-quobyte-71eb9621-3695-4edf-916c-6bb411853cfc" released by "_delete_snapshot" :: held 1.702s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:10 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ea3676d2-a625-4cf3-aad6-18451070634d tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-quobyte-09c6947f-ab06-48c2-9e20-16c62f44a46c" released by "delete_snapshot" :: held 1.731s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:10 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-ea3676d2-a625-4cf3-aad6-18451070634d tempest-CreateVolumesFromSnapshotTest-847186939 None] Created reservations ['9893f169-a54a-46fd-a2d0-f541d4c331c3', '1d5ac317-ac1d-41e6-80ab-3e9d01c95f2d', '1b2fad5b-8a06-49e4-b701-87ce716edbde', 'd9c1b9d3-81b7-43a4-97f2-bbad58689a24'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:10 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ea3676d2-a625-4cf3-aad6-18451070634d tempest-CreateVolumesFromSnapshotTest-847186939 None] Delete snapshot completed successfully. Sep 09 18:23:10 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ea3676d2-a625-4cf3-aad6-18451070634d tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-71eb9621-3695-4edf-916c-6bb411853cfc-delete_snapshot" released by "delete_snapshot" :: held 1.877s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:11 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-de5628e3-d41c-4125-a0b9-bad7903d3776 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Acquiring lock "cinder-e4c97813-9a24-425b-ab69-3fe7af900cac-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:11 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-de5628e3-d41c-4125-a0b9-bad7903d3776 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Lock "cinder-e4c97813-9a24-425b-ab69-3fe7af900cac-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:11 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-de5628e3-d41c-4125-a0b9-bad7903d3776 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Acquiring lock "cinder-quobyte-e4c97813-9a24-425b-ab69-3fe7af900cac" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:11 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d559bfc5-0b3e-4fce-ae6d-8b79b852c515 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "cinder-09c6947f-ab06-48c2-9e20-16c62f44a46c-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:11 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-de5628e3-d41c-4125-a0b9-bad7903d3776 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Lock "cinder-quobyte-e4c97813-9a24-425b-ab69-3fe7af900cac" acquired by "delete_volume" :: waited 0.034s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:11 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d559bfc5-0b3e-4fce-ae6d-8b79b852c515 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-09c6947f-ab06-48c2-9e20-16c62f44a46c-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:11 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6b15bb-feb9-4921-a764-8d36676ea680]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-de5628e3-d41c-4125-a0b9-bad7903d3776 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:11 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d559bfc5-0b3e-4fce-ae6d-8b79b852c515 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "cinder-quobyte-09c6947f-ab06-48c2-9e20-16c62f44a46c" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:11 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d559bfc5-0b3e-4fce-ae6d-8b79b852c515 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-quobyte-09c6947f-ab06-48c2-9e20-16c62f44a46c" acquired by "delete_volume" :: waited 0.031s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:11 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96ab53d-a76f-4acd-9327-074a51c46093]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d559bfc5-0b3e-4fce-ae6d-8b79b852c515 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:11 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac Sep 09 18:23:11 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:11 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c Sep 09 18:23:11 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:11 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-de5628e3-d41c-4125-a0b9-bad7903d3776 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac" returned: 0 in 0.461s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-de5628e3-d41c-4125-a0b9-bad7903d3776 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:11 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac Sep 09 18:23:11 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:11 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d559bfc5-0b3e-4fce-ae6d-8b79b852c515 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c" returned: 0 in 0.396s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d559bfc5-0b3e-4fce-ae6d-8b79b852c515 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:11 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c Sep 09 18:23:11 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:12 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-de5628e3-d41c-4125-a0b9-bad7903d3776 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e4c97813-9a24-425b-ab69-3fe7af900cac" returned: 0 in 0.301s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-de5628e3-d41c-4125-a0b9-bad7903d3776 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Lock "cinder-quobyte-e4c97813-9a24-425b-ab69-3fe7af900cac" released by "delete_volume" :: held 0.869s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:12 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d559bfc5-0b3e-4fce-ae6d-8b79b852c515 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-09c6947f-ab06-48c2-9e20-16c62f44a46c" returned: 0 in 0.303s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-de5628e3-d41c-4125-a0b9-bad7903d3776 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Created reservations ['291c4590-3d50-4e76-946d-07ad1adf2fa0', '83de7f0a-e57a-4b75-b3b7-e0c975c358d5', '89f9f501-5e43-43bb-8fc1-b1f83ba07281', 'e6b77772-dd76-4808-8aa7-bfb453c78ede'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d559bfc5-0b3e-4fce-ae6d-8b79b852c515 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-quobyte-09c6947f-ab06-48c2-9e20-16c62f44a46c" released by "delete_volume" :: held 0.776s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-de5628e3-d41c-4125-a0b9-bad7903d3776 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-de5628e3-d41c-4125-a0b9-bad7903d3776 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-de5628e3-d41c-4125-a0b9-bad7903d3776 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-de5628e3-d41c-4125-a0b9-bad7903d3776 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-de5628e3-d41c-4125-a0b9-bad7903d3776 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-de5628e3-d41c-4125-a0b9-bad7903d3776 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-d559bfc5-0b3e-4fce-ae6d-8b79b852c515 tempest-CreateVolumesFromSnapshotTest-847186939 None] Created reservations ['537e3d7b-af3b-40c5-ab61-34fc3dc875c5', '7e1fda6a-dc6c-4d76-bfc9-9e1c9ecc9383', '3e5a8f39-8b6f-44b8-831e-78831814c7c5', '468af87a-a9a0-4867-a7a3-d24647c4a8e0'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:12 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:23:12 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d559bfc5-0b3e-4fce-ae6d-8b79b852c515 tempest-CreateVolumesFromSnapshotTest-847186939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d559bfc5-0b3e-4fce-ae6d-8b79b852c515 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d559bfc5-0b3e-4fce-ae6d-8b79b852c515 tempest-CreateVolumesFromSnapshotTest-847186939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d559bfc5-0b3e-4fce-ae6d-8b79b852c515 tempest-CreateVolumesFromSnapshotTest-847186939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d559bfc5-0b3e-4fce-ae6d-8b79b852c515 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d559bfc5-0b3e-4fce-ae6d-8b79b852c515 tempest-CreateVolumesFromSnapshotTest-847186939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:12 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:23:12 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:12 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-de5628e3-d41c-4125-a0b9-bad7903d3776 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.322s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-de5628e3-d41c-4125-a0b9-bad7903d3776 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:12 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-de5628e3-d41c-4125-a0b9-bad7903d3776 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Deleted volume successfully. Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-de5628e3-d41c-4125-a0b9-bad7903d3776 tempest-VolumesSnapshotNegativeTestJSON-1177403781 None] Lock "cinder-e4c97813-9a24-425b-ab69-3fe7af900cac-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:12 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d559bfc5-0b3e-4fce-ae6d-8b79b852c515 tempest-CreateVolumesFromSnapshotTest-847186939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.271s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-d559bfc5-0b3e-4fce-ae6d-8b79b852c515 tempest-CreateVolumesFromSnapshotTest-847186939 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:12 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d559bfc5-0b3e-4fce-ae6d-8b79b852c515 tempest-CreateVolumesFromSnapshotTest-847186939 None] Deleted volume successfully. Sep 09 18:23:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d559bfc5-0b3e-4fce-ae6d-8b79b852c515 tempest-CreateVolumesFromSnapshotTest-847186939 None] Lock "cinder-09c6947f-ab06-48c2-9e20-16c62f44a46c-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:17 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:23:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Flow 'volume_create_manager' (a14e5b42-c4c7-42dc-a38c-39b39c827043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688d01cd-ac72-4bcd-8d9a-babfbffaab34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688d01cd-ac72-4bcd-8d9a-babfbffaab34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1855132676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f5399d-6b89-45c5-a2da-ae1baee979d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c1da29d124992b2e1f4e1570aa5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:17Z,use_quota=True,user_id='e31fbcb832f0479da2a8f976eb448206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c6c6d3b-aa16-43dc-a3f1-e9914852e71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c6c6d3b-aa16-43dc-a3f1-e9914852e71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (260d9db5-dc95-4193-93d4-63712c8f6e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (260d9db5-dc95-4193-93d4-63712c8f6e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23f5399d-6b89-45c5-a2da-ae1baee979d4', 'volume_name': 'volume-23f5399d-6b89-45c5-a2da-ae1baee979d4', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58af3073-36b0-48a6-ac70-94663308b9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58af3073-36b0-48a6-ac70-94663308b9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20ae880-389b-4dbc-9476-4ff3612b76f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:17 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Volume 23f5399d-6b89-45c5-a2da-ae1baee979d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23f5399d-6b89-45c5-a2da-ae1baee979d4', 'volume_size': 1} Sep 09 18:23:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1855132676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f5399d-6b89-45c5-a2da-ae1baee979d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c1da29d124992b2e1f4e1570aa5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:17Z,use_quota=True,user_id='e31fbcb832f0479da2a8f976eb448206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:23:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Creating volume 23f5399d-6b89-45c5-a2da-ae1baee979d4 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:23:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:23:17 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:23:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-23f5399d-6b89-45c5-a2da-ae1baee979d4 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:17 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-23f5399d-6b89-45c5-a2da-ae1baee979d4 1073741824 Sep 09 18:23:17 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:18 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-23f5399d-6b89-45c5-a2da-ae1baee979d4 1073741824" returned: 0 in 0.556s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-23f5399d-6b89-45c5-a2da-ae1baee979d4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:18 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-23f5399d-6b89-45c5-a2da-ae1baee979d4 Sep 09 18:23:18 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:18 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-23f5399d-6b89-45c5-a2da-ae1baee979d4" returned: 0 in 0.301s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:18 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:23:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:18 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20ae880-389b-4dbc-9476-4ff3612b76f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23f5399d-6b89-45c5-a2da-ae1baee979d4', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:18 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826df015-1b77-432c-a2de-5c6ce3dbbd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:18 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Volume volume-23f5399d-6b89-45c5-a2da-ae1baee979d4 (23f5399d-6b89-45c5-a2da-ae1baee979d4): created successfully Sep 09 18:23:18 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826df015-1b77-432c-a2de-5c6ce3dbbd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:18 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Flow 'volume_create_manager' (a14e5b42-c4c7-42dc-a38c-39b39c827043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:18 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-884bed54-cba6-4e29-b1bb-e17071787064 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Created volume successfully. Sep 09 18:23:19 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:23:19 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Flow 'volume_create_manager' (89d75743-570d-4ab9-b722-9b9b889ac6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:19 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fb65b6a-3413-4ef4-b87a-62180b18d01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:19 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fb65b6a-3413-4ef4-b87a-62180b18d01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-284118227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66fa051d-5d90-445d-b515-1a24730bdcff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c1da29d124992b2e1f4e1570aa5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:20Z,use_quota=True,user_id='e31fbcb832f0479da2a8f976eb448206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:19 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038d148f-c8b9-42b8-8b98-2b8d0beb300e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038d148f-c8b9-42b8-8b98-2b8d0beb300e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c441196-7ebb-4b72-b6e7-b1420ed2d480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c441196-7ebb-4b72-b6e7-b1420ed2d480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66fa051d-5d90-445d-b515-1a24730bdcff', 'volume_name': 'volume-66fa051d-5d90-445d-b515-1a24730bdcff', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae8d1956-b846-49de-806a-0341592d241d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae8d1956-b846-49de-806a-0341592d241d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4da243-c272-487a-89c4-7ae699d53c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:20 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Volume 66fa051d-5d90-445d-b515-1a24730bdcff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66fa051d-5d90-445d-b515-1a24730bdcff', 'volume_size': 1} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-284118227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66fa051d-5d90-445d-b515-1a24730bdcff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c1da29d124992b2e1f4e1570aa5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:20Z,use_quota=True,user_id='e31fbcb832f0479da2a8f976eb448206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Creating volume 66fa051d-5d90-445d-b515-1a24730bdcff {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:23:20 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66fa051d-5d90-445d-b515-1a24730bdcff 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:20 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66fa051d-5d90-445d-b515-1a24730bdcff 1073741824 Sep 09 18:23:20 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Flow 'volume_create_manager' (200def38-360f-4cec-95fc-369845e9e2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d684834-44f1-41c6-8f24-47585343f155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d684834-44f1-41c6-8f24-47585343f155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-584862546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36527681-a8cc-45f2-86ff-e1833a98d3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731f754cf10b474c90865f073d6f08f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:20Z,use_quota=True,user_id='66faa0925ac642309e96cbc4108333cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dced961b-a376-4ee8-88b9-76949a7f83a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dced961b-a376-4ee8-88b9-76949a7f83a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c3999a-05ff-4a19-9212-7b07192597c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c3999a-05ff-4a19-9212-7b07192597c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36527681-a8cc-45f2-86ff-e1833a98d3f4', 'volume_name': 'volume-36527681-a8cc-45f2-86ff-e1833a98d3f4', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c011e622-f0d2-42ef-a837-6253584d7a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c011e622-f0d2-42ef-a837-6253584d7a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55edad2a-e4f9-45d4-9fbc-2b6f5c3fda29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:20 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Volume 36527681-a8cc-45f2-86ff-e1833a98d3f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36527681-a8cc-45f2-86ff-e1833a98d3f4', 'volume_size': 1} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Flow 'volume_create_manager' (04ef1b65-f004-4bcb-b8d9-ac9a94be9442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:20 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe62256e-fee2-4fc6-a9ae-89ccad8c84ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66fa051d-5d90-445d-b515-1a24730bdcff 1073741824" returned: 0 in 0.727s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe62256e-fee2-4fc6-a9ae-89ccad8c84ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-467312554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d464440-be87-4153-bfff-deeba8be375b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c1da29d124992b2e1f4e1570aa5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:21Z,use_quota=True,user_id='e31fbcb832f0479da2a8f976eb448206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6aeb4e-1463-4b95-a551-eb7c9e308025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6aeb4e-1463-4b95-a551-eb7c9e308025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (509ec9fa-265c-46c1-9620-ae6d9d0ab0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (509ec9fa-265c-46c1-9620-ae6d9d0ab0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d464440-be87-4153-bfff-deeba8be375b', 'volume_name': 'volume-4d464440-be87-4153-bfff-deeba8be375b', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ca6a91-1ba5-46cc-a29d-affc542bfbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ca6a91-1ba5-46cc-a29d-affc542bfbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebbbfb24-4375-4a47-aa8d-c15cfd5b1a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:20 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Volume 4d464440-be87-4153-bfff-deeba8be375b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d464440-be87-4153-bfff-deeba8be375b', 'volume_size': 1} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66fa051d-5d90-445d-b515-1a24730bdcff {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:20 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66fa051d-5d90-445d-b515-1a24730bdcff Sep 09 18:23:20 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Flow 'volume_create_manager' (b166da82-5f4f-4a0b-9e77-74ecc77790e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee9cfef5-ef47-4399-877a-dee1714e8ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee9cfef5-ef47-4399-877a-dee1714e8ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-782608366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d53c354e-d1c5-4e04-9bb6-1808a19af0f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c1da29d124992b2e1f4e1570aa5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:21Z,use_quota=True,user_id='e31fbcb832f0479da2a8f976eb448206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee0e97d-9164-479f-9861-b3497bd94551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee0e97d-9164-479f-9861-b3497bd94551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a642d4cc-8700-4206-8072-b65d4ba898dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a642d4cc-8700-4206-8072-b65d4ba898dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd53c354e-d1c5-4e04-9bb6-1808a19af0f4', 'volume_name': 'volume-d53c354e-d1c5-4e04-9bb6-1808a19af0f4', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8c3ea3-32e5-4728-8e3b-b2aeae9c96bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8c3ea3-32e5-4728-8e3b-b2aeae9c96bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cd5c8c-cba0-4d03-9d7c-52ad0e71a943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:21 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Volume d53c354e-d1c5-4e04-9bb6-1808a19af0f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d53c354e-d1c5-4e04-9bb6-1808a19af0f4', 'volume_size': 1} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:21 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66fa051d-5d90-445d-b515-1a24730bdcff" returned: 0 in 0.346s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.615s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-584862546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36527681-a8cc-45f2-86ff-e1833a98d3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731f754cf10b474c90865f073d6f08f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:20Z,use_quota=True,user_id='66faa0925ac642309e96cbc4108333cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Creating volume 36527681-a8cc-45f2-86ff-e1833a98d3f4 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:23:21 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-36527681-a8cc-45f2-86ff-e1833a98d3f4 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4da243-c272-487a-89c4-7ae699d53c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66fa051d-5d90-445d-b515-1a24730bdcff', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acaa1995-8ced-450c-a66f-08c481a54769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:21 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-36527681-a8cc-45f2-86ff-e1833a98d3f4 1073741824 Sep 09 18:23:21 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:21 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Volume volume-66fa051d-5d90-445d-b515-1a24730bdcff (66fa051d-5d90-445d-b515-1a24730bdcff): created successfully Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acaa1995-8ced-450c-a66f-08c481a54769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Flow 'volume_create_manager' (89d75743-570d-4ab9-b722-9b9b889ac6fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:21 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-4b0236dd-3d8f-458a-8160-1d6a8822ca43 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Created volume successfully. Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Flow 'volume_create_manager' (49dd89e2-d7ec-480a-9977-793b4aaa146e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4be542-def8-4980-9493-1da196a0b7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4be542-def8-4980-9493-1da196a0b7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-685101864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32bbc67c-70a7-432c-a31c-98595fd6a371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c1da29d124992b2e1f4e1570aa5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:22Z,use_quota=True,user_id='e31fbcb832f0479da2a8f976eb448206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a61a0a-cdcd-45c8-a088-b4f3e37fa0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a61a0a-cdcd-45c8-a088-b4f3e37fa0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b094a53-ec25-4f5b-8bca-f90e52fa340e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b094a53-ec25-4f5b-8bca-f90e52fa340e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32bbc67c-70a7-432c-a31c-98595fd6a371', 'volume_name': 'volume-32bbc67c-70a7-432c-a31c-98595fd6a371', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866277bf-9533-42e5-8713-344c37f767c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866277bf-9533-42e5-8713-344c37f767c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9566b5de-9c50-40b6-9faa-1bdd601637c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:21 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Volume 32bbc67c-70a7-432c-a31c-98595fd6a371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32bbc67c-70a7-432c-a31c-98595fd6a371', 'volume_size': 1} Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:21 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-36527681-a8cc-45f2-86ff-e1833a98d3f4 1073741824" returned: 0 in 0.687s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-36527681-a8cc-45f2-86ff-e1833a98d3f4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:22 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-36527681-a8cc-45f2-86ff-e1833a98d3f4 Sep 09 18:23:22 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Flow 'volume_create_manager' (a2bd30e4-7a41-47cf-9546-e455832b495d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af06670-93be-4a69-a134-5c4ca7785cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af06670-93be-4a69-a134-5c4ca7785cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1871141927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6c7686-df18-42ae-9ca8-32c574e1dfe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c1da29d124992b2e1f4e1570aa5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:22Z,use_quota=True,user_id='e31fbcb832f0479da2a8f976eb448206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2117bd4-ff82-4b70-bf53-135fb97bb45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2117bd4-ff82-4b70-bf53-135fb97bb45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef5bf58-0ee8-49ca-bf3c-351d4749edb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef5bf58-0ee8-49ca-bf3c-351d4749edb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e6c7686-df18-42ae-9ca8-32c574e1dfe9', 'volume_name': 'volume-6e6c7686-df18-42ae-9ca8-32c574e1dfe9', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7ed334-893d-4f8e-b4e7-5eba5319c915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b7ed334-893d-4f8e-b4e7-5eba5319c915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44082a3d-3842-491a-83ac-aed85b731951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:22 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Volume 6e6c7686-df18-42ae-9ca8-32c574e1dfe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e6c7686-df18-42ae-9ca8-32c574e1dfe9', 'volume_size': 1} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:22 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-36527681-a8cc-45f2-86ff-e1833a98d3f4" returned: 0 in 0.540s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.700s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-467312554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d464440-be87-4153-bfff-deeba8be375b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c1da29d124992b2e1f4e1570aa5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:21Z,use_quota=True,user_id='e31fbcb832f0479da2a8f976eb448206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Creating volume 4d464440-be87-4153-bfff-deeba8be375b {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:23:22 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d464440-be87-4153-bfff-deeba8be375b 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:22 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d464440-be87-4153-bfff-deeba8be375b 1073741824 Sep 09 18:23:22 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55edad2a-e4f9-45d4-9fbc-2b6f5c3fda29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36527681-a8cc-45f2-86ff-e1833a98d3f4', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43ad418-1639-4347-874f-9497d97252e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:22 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Volume volume-36527681-a8cc-45f2-86ff-e1833a98d3f4 (36527681-a8cc-45f2-86ff-e1833a98d3f4): created successfully Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43ad418-1639-4347-874f-9497d97252e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Flow 'volume_create_manager' (200def38-360f-4cec-95fc-369845e9e2d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:22 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-b6c26aca-f4e8-4b47-9491-0cc2723681d7 tempest-VolumesTransfersV355Test-2045964316 None] Created volume successfully. Sep 09 18:23:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-099f2a39-0520-446d-b009-77d5dae57269 req-adb8e323-97e0-4ed2-8f11-2624ced43d2b tempest-TestInstancesWithCinderVolumes-1868759752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:23 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d464440-be87-4153-bfff-deeba8be375b 1073741824" returned: 0 in 0.531s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d464440-be87-4153-bfff-deeba8be375b {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:23 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d464440-be87-4153-bfff-deeba8be375b Sep 09 18:23:23 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:23 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d464440-be87-4153-bfff-deeba8be375b" returned: 0 in 0.275s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:23:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.299s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-782608366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d53c354e-d1c5-4e04-9bb6-1808a19af0f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c1da29d124992b2e1f4e1570aa5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:21Z,use_quota=True,user_id='e31fbcb832f0479da2a8f976eb448206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:23:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Creating volume d53c354e-d1c5-4e04-9bb6-1808a19af0f4 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:23:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:23:23 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:23:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d53c354e-d1c5-4e04-9bb6-1808a19af0f4 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:23 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebbbfb24-4375-4a47-aa8d-c15cfd5b1a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d464440-be87-4153-bfff-deeba8be375b', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:23 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d53c354e-d1c5-4e04-9bb6-1808a19af0f4 1073741824 Sep 09 18:23:23 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:23 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2691903-ae29-45b2-ad20-acd04e88f161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:23 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Volume volume-4d464440-be87-4153-bfff-deeba8be375b (4d464440-be87-4153-bfff-deeba8be375b): created successfully Sep 09 18:23:23 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2691903-ae29-45b2-ad20-acd04e88f161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:23 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Flow 'volume_create_manager' (04ef1b65-f004-4bcb-b8d9-ac9a94be9442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:23 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-1f2e0a84-28eb-4ea5-b6cb-d832f246f47e tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Created volume successfully. Sep 09 18:23:24 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d53c354e-d1c5-4e04-9bb6-1808a19af0f4 1073741824" returned: 0 in 0.594s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d53c354e-d1c5-4e04-9bb6-1808a19af0f4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:24 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d53c354e-d1c5-4e04-9bb6-1808a19af0f4 Sep 09 18:23:24 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:24 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-04937572-e988-468a-be08-cf418d2a6d1b tempest-VolumesTransfersV355Test-880350222 None] Transfer volume completed successfully. Sep 09 18:23:24 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d53c354e-d1c5-4e04-9bb6-1808a19af0f4" returned: 0 in 0.399s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:23:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.758s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-685101864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32bbc67c-70a7-432c-a31c-98595fd6a371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c1da29d124992b2e1f4e1570aa5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:22Z,use_quota=True,user_id='e31fbcb832f0479da2a8f976eb448206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:23:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Creating volume 32bbc67c-70a7-432c-a31c-98595fd6a371 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:23:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:23:24 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:23:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-32bbc67c-70a7-432c-a31c-98595fd6a371 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cd5c8c-cba0-4d03-9d7c-52ad0e71a943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d53c354e-d1c5-4e04-9bb6-1808a19af0f4', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54eaeb7f-7561-443e-98ab-6fc02693a90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:24 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-32bbc67c-70a7-432c-a31c-98595fd6a371 1073741824 Sep 09 18:23:24 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:24 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Volume volume-d53c354e-d1c5-4e04-9bb6-1808a19af0f4 (d53c354e-d1c5-4e04-9bb6-1808a19af0f4): created successfully Sep 09 18:23:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54eaeb7f-7561-443e-98ab-6fc02693a90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Flow 'volume_create_manager' (b166da82-5f4f-4a0b-9e77-74ecc77790e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:24 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-913bdd2f-467a-46bb-948e-1cde7dfc1f4f tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Created volume successfully. Sep 09 18:23:25 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-32bbc67c-70a7-432c-a31c-98595fd6a371 1073741824" returned: 0 in 0.607s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-32bbc67c-70a7-432c-a31c-98595fd6a371 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:25 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-32bbc67c-70a7-432c-a31c-98595fd6a371 Sep 09 18:23:25 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-99c1de25-1807-4b6c-8904-4b868cee7f9c tempest-VolumesTransfersV355Test-121438662 None] Acquiring lock "cinder-36527681-a8cc-45f2-86ff-e1833a98d3f4-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-99c1de25-1807-4b6c-8904-4b868cee7f9c tempest-VolumesTransfersV355Test-121438662 None] Lock "cinder-36527681-a8cc-45f2-86ff-e1833a98d3f4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-99c1de25-1807-4b6c-8904-4b868cee7f9c tempest-VolumesTransfersV355Test-121438662 None] Acquiring lock "cinder-quobyte-36527681-a8cc-45f2-86ff-e1833a98d3f4" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-99c1de25-1807-4b6c-8904-4b868cee7f9c tempest-VolumesTransfersV355Test-121438662 None] Lock "cinder-quobyte-36527681-a8cc-45f2-86ff-e1833a98d3f4" acquired by "delete_volume" :: waited 0.026s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:25 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-32bbc67c-70a7-432c-a31c-98595fd6a371" returned: 0 in 0.343s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.026s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1871141927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e6c7686-df18-42ae-9ca8-32c574e1dfe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='248c1da29d124992b2e1f4e1570aa5ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:22Z,use_quota=True,user_id='e31fbcb832f0479da2a8f976eb448206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Creating volume 6e6c7686-df18-42ae-9ca8-32c574e1dfe9 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:23:25 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6e6c7686-df18-42ae-9ca8-32c574e1dfe9 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[920171f5-9c09-4d37-8bfe-433542657a51]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-99c1de25-1807-4b6c-8904-4b868cee7f9c tempest-VolumesTransfersV355Test-121438662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-36527681-a8cc-45f2-86ff-e1833a98d3f4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:25 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6e6c7686-df18-42ae-9ca8-32c574e1dfe9 1073741824 Sep 09 18:23:25 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9566b5de-9c50-40b6-9faa-1bdd601637c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32bbc67c-70a7-432c-a31c-98595fd6a371', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4ccbdb8-adcd-463a-b07d-10e203228c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:25 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Volume volume-32bbc67c-70a7-432c-a31c-98595fd6a371 (32bbc67c-70a7-432c-a31c-98595fd6a371): created successfully Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4ccbdb8-adcd-463a-b07d-10e203228c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Flow 'volume_create_manager' (49dd89e2-d7ec-480a-9977-793b4aaa146e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:25 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-eb88bd8b-838b-4c94-87d7-9700ebcc9e61 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Created volume successfully. Sep 09 18:23:25 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-36527681-a8cc-45f2-86ff-e1833a98d3f4 Sep 09 18:23:25 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:26 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-99c1de25-1807-4b6c-8904-4b868cee7f9c tempest-VolumesTransfersV355Test-121438662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-36527681-a8cc-45f2-86ff-e1833a98d3f4" returned: 0 in 0.503s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-99c1de25-1807-4b6c-8904-4b868cee7f9c tempest-VolumesTransfersV355Test-121438662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-36527681-a8cc-45f2-86ff-e1833a98d3f4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:26 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-36527681-a8cc-45f2-86ff-e1833a98d3f4 Sep 09 18:23:26 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:26 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6e6c7686-df18-42ae-9ca8-32c574e1dfe9 1073741824" returned: 0 in 0.613s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6e6c7686-df18-42ae-9ca8-32c574e1dfe9 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:26 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6e6c7686-df18-42ae-9ca8-32c574e1dfe9 Sep 09 18:23:26 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:26 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-99c1de25-1807-4b6c-8904-4b868cee7f9c tempest-VolumesTransfersV355Test-121438662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-36527681-a8cc-45f2-86ff-e1833a98d3f4" returned: 0 in 0.456s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-99c1de25-1807-4b6c-8904-4b868cee7f9c tempest-VolumesTransfersV355Test-121438662 None] Lock "cinder-quobyte-36527681-a8cc-45f2-86ff-e1833a98d3f4" released by "delete_volume" :: held 1.053s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:26 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6e6c7686-df18-42ae-9ca8-32c574e1dfe9" returned: 0 in 0.429s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-099f2a39-0520-446d-b009-77d5dae57269 req-adb8e323-97e0-4ed2-8f11-2624ced43d2b tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.836s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-099f2a39-0520-446d-b009-77d5dae57269 req-adb8e323-97e0-4ed2-8f11-2624ced43d2b tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44082a3d-3842-491a-83ac-aed85b731951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e6c7686-df18-42ae-9ca8-32c574e1dfe9', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd96c612-873b-43c6-9e76-b4c6e6235682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-99c1de25-1807-4b6c-8904-4b868cee7f9c tempest-VolumesTransfersV355Test-121438662 None] Created reservations ['5609ec13-a928-42f1-beb0-cc1cf9b4134c', '8ef27c80-3d91-4b0a-8cd8-550362112e56', '23249b0e-0098-464f-8c7d-51ff0fdf898d', '77791718-f06e-4a2c-861c-336988440022'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:26 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Volume volume-6e6c7686-df18-42ae-9ca8-32c574e1dfe9 (6e6c7686-df18-42ae-9ca8-32c574e1dfe9): created successfully Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd96c612-873b-43c6-9e76-b4c6e6235682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Flow 'volume_create_manager' (a2bd30e4-7a41-47cf-9546-e455832b495d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:26 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-80d7d3dd-d107-4a50-b876-224e913d7e07 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Created volume successfully. Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-099f2a39-0520-446d-b009-77d5dae57269 req-adb8e323-97e0-4ed2-8f11-2624ced43d2b tempest-TestInstancesWithCinderVolumes-1868759752 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-42e381b9-b926-44a8-9a62-a934f5f711d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6d3b54b-094f-4bee-bcd1-e9c8c4f72cbc', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-99c1de25-1807-4b6c-8904-4b868cee7f9c tempest-VolumesTransfersV355Test-121438662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-99c1de25-1807-4b6c-8904-4b868cee7f9c tempest-VolumesTransfersV355Test-121438662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-99c1de25-1807-4b6c-8904-4b868cee7f9c tempest-VolumesTransfersV355Test-121438662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-99c1de25-1807-4b6c-8904-4b868cee7f9c tempest-VolumesTransfersV355Test-121438662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-99c1de25-1807-4b6c-8904-4b868cee7f9c tempest-VolumesTransfersV355Test-121438662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-99c1de25-1807-4b6c-8904-4b868cee7f9c tempest-VolumesTransfersV355Test-121438662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:26 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:23:26 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:26 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-099f2a39-0520-446d-b009-77d5dae57269 req-adb8e323-97e0-4ed2-8f11-2624ced43d2b tempest-TestInstancesWithCinderVolumes-1868759752 None] attachment_update completed successfully. Sep 09 18:23:27 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-99c1de25-1807-4b6c-8904-4b868cee7f9c tempest-VolumesTransfersV355Test-121438662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.336s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:27 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-99c1de25-1807-4b6c-8904-4b868cee7f9c tempest-VolumesTransfersV355Test-121438662 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:27 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-99c1de25-1807-4b6c-8904-4b868cee7f9c tempest-VolumesTransfersV355Test-121438662 None] Deleted volume successfully. Sep 09 18:23:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-99c1de25-1807-4b6c-8904-4b868cee7f9c tempest-VolumesTransfersV355Test-121438662 None] Lock "cinder-36527681-a8cc-45f2-86ff-e1833a98d3f4-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-76b412eb-b849-4bb0-815f-4a64f82ee97a tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "cinder-6e6c7686-df18-42ae-9ca8-32c574e1dfe9-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-76b412eb-b849-4bb0-815f-4a64f82ee97a tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-6e6c7686-df18-42ae-9ca8-32c574e1dfe9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-76b412eb-b849-4bb0-815f-4a64f82ee97a tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "cinder-quobyte-6e6c7686-df18-42ae-9ca8-32c574e1dfe9" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-76b412eb-b849-4bb0-815f-4a64f82ee97a tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-quobyte-6e6c7686-df18-42ae-9ca8-32c574e1dfe9" acquired by "delete_volume" :: waited 0.026s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:27 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba682e89-d8fd-4f01-9e34-f3f2e84cc5a9]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-76b412eb-b849-4bb0-815f-4a64f82ee97a tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6e6c7686-df18-42ae-9ca8-32c574e1dfe9 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:27 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6e6c7686-df18-42ae-9ca8-32c574e1dfe9 Sep 09 18:23:27 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:28 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-76b412eb-b849-4bb0-815f-4a64f82ee97a tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6e6c7686-df18-42ae-9ca8-32c574e1dfe9" returned: 0 in 0.499s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-76b412eb-b849-4bb0-815f-4a64f82ee97a tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6e6c7686-df18-42ae-9ca8-32c574e1dfe9 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:28 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6e6c7686-df18-42ae-9ca8-32c574e1dfe9 Sep 09 18:23:28 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Flow 'volume_create_manager' (9bda0248-4d8e-4244-8914-35ae7547f39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f9d3f63-00ac-4231-a7e9-8114aa983655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f9d3f63-00ac-4231-a7e9-8114aa983655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1669755613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f22a1e-a68d-4f5f-a2d1-9388a370debf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731f754cf10b474c90865f073d6f08f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:28Z,use_quota=True,user_id='66faa0925ac642309e96cbc4108333cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18658141-db5c-48ea-a8b8-9dd191f94843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18658141-db5c-48ea-a8b8-9dd191f94843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac141e1-b47b-483a-8f27-b445c6165b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fac141e1-b47b-483a-8f27-b445c6165b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29f22a1e-a68d-4f5f-a2d1-9388a370debf', 'volume_name': 'volume-29f22a1e-a68d-4f5f-a2d1-9388a370debf', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3a2834-5d72-413b-9109-2acf6f5bc98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3a2834-5d72-413b-9109-2acf6f5bc98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b8c181-3c62-4edc-b89c-9094b219edbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:28 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Volume 29f22a1e-a68d-4f5f-a2d1-9388a370debf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29f22a1e-a68d-4f5f-a2d1-9388a370debf', 'volume_size': 1} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1669755613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f22a1e-a68d-4f5f-a2d1-9388a370debf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='731f754cf10b474c90865f073d6f08f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:28Z,use_quota=True,user_id='66faa0925ac642309e96cbc4108333cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Creating volume 29f22a1e-a68d-4f5f-a2d1-9388a370debf {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:23:28 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-29f22a1e-a68d-4f5f-a2d1-9388a370debf 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:28 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-76b412eb-b849-4bb0-815f-4a64f82ee97a tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-6e6c7686-df18-42ae-9ca8-32c574e1dfe9" returned: 0 in 0.344s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:28 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-29f22a1e-a68d-4f5f-a2d1-9388a370debf 1073741824 Sep 09 18:23:28 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-76b412eb-b849-4bb0-815f-4a64f82ee97a tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-quobyte-6e6c7686-df18-42ae-9ca8-32c574e1dfe9" released by "delete_volume" :: held 0.944s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-76b412eb-b849-4bb0-815f-4a64f82ee97a tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Created reservations ['6df7f388-a51d-4e0b-a631-2bc81c40c11f', '19a575e8-cbc0-450e-8276-4980682867fa', '92447055-f137-4ba0-9a61-709da09b181f', '2e7991d8-d00c-4939-bf9e-6d232a3b4c68'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-76b412eb-b849-4bb0-815f-4a64f82ee97a tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-76b412eb-b849-4bb0-815f-4a64f82ee97a tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-76b412eb-b849-4bb0-815f-4a64f82ee97a tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-76b412eb-b849-4bb0-815f-4a64f82ee97a tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-76b412eb-b849-4bb0-815f-4a64f82ee97a tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-76b412eb-b849-4bb0-815f-4a64f82ee97a tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:28 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:23:28 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:29 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:29 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-76b412eb-b849-4bb0-815f-4a64f82ee97a tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.342s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:29 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-76b412eb-b849-4bb0-815f-4a64f82ee97a tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-29f22a1e-a68d-4f5f-a2d1-9388a370debf 1073741824" returned: 0 in 0.580s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:29 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-76b412eb-b849-4bb0-815f-4a64f82ee97a tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Deleted volume successfully. Sep 09 18:23:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-76b412eb-b849-4bb0-815f-4a64f82ee97a tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-6e6c7686-df18-42ae-9ca8-32c574e1dfe9-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-29f22a1e-a68d-4f5f-a2d1-9388a370debf {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:29 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-29f22a1e-a68d-4f5f-a2d1-9388a370debf Sep 09 18:23:29 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:29 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-29f22a1e-a68d-4f5f-a2d1-9388a370debf" returned: 0 in 0.323s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:23:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6b8c181-3c62-4edc-b89c-9094b219edbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29f22a1e-a68d-4f5f-a2d1-9388a370debf', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba92668-a150-43df-8052-3c115978e22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:29 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Volume volume-29f22a1e-a68d-4f5f-a2d1-9388a370debf (29f22a1e-a68d-4f5f-a2d1-9388a370debf): created successfully Sep 09 18:23:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba92668-a150-43df-8052-3c115978e22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Flow 'volume_create_manager' (9bda0248-4d8e-4244-8914-35ae7547f39d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:29 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-a11a7e2b-d33a-4b8d-861c-86bbe0a1a2b2 tempest-VolumesTransfersV355Test-2045964316 None] Created volume successfully. Sep 09 18:23:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-289199a8-c880-4115-bef2-f3fd2504ad00 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "cinder-32bbc67c-70a7-432c-a31c-98595fd6a371-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-289199a8-c880-4115-bef2-f3fd2504ad00 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-32bbc67c-70a7-432c-a31c-98595fd6a371-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-289199a8-c880-4115-bef2-f3fd2504ad00 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "cinder-quobyte-32bbc67c-70a7-432c-a31c-98595fd6a371" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-289199a8-c880-4115-bef2-f3fd2504ad00 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-quobyte-32bbc67c-70a7-432c-a31c-98595fd6a371" acquired by "delete_volume" :: waited 0.024s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:30 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6572c9-61be-48f9-b93d-cc7cc5c9387f]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-289199a8-c880-4115-bef2-f3fd2504ad00 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-32bbc67c-70a7-432c-a31c-98595fd6a371 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-e37a4d66-9182-4e0d-9dee-3a47877f5cb9 req-d1597816-4f72-48d0-a9cf-8ccc30f62d73 tempest-TestInstancesWithCinderVolumes-1868759752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-e37a4d66-9182-4e0d-9dee-3a47877f5cb9 req-d1597816-4f72-48d0-a9cf-8ccc30f62d73 tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-e37a4d66-9182-4e0d-9dee-3a47877f5cb9 req-d1597816-4f72-48d0-a9cf-8ccc30f62d73 tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-e37a4d66-9182-4e0d-9dee-3a47877f5cb9 req-d1597816-4f72-48d0-a9cf-8ccc30f62d73 tempest-TestInstancesWithCinderVolumes-1868759752 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-b5e172a0-53cb-4e1c-8442-5da62b913e38', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0bd12ee-e322-42a7-9e6a-448fdfc0d2b4', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:23:30 devstack sudo[101045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-32bbc67c-70a7-432c-a31c-98595fd6a371 Sep 09 18:23:30 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:30 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-e37a4d66-9182-4e0d-9dee-3a47877f5cb9 req-d1597816-4f72-48d0-a9cf-8ccc30f62d73 tempest-TestInstancesWithCinderVolumes-1868759752 None] attachment_update completed successfully. Sep 09 18:23:30 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-289199a8-c880-4115-bef2-f3fd2504ad00 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-32bbc67c-70a7-432c-a31c-98595fd6a371" returned: 0 in 0.442s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-289199a8-c880-4115-bef2-f3fd2504ad00 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-32bbc67c-70a7-432c-a31c-98595fd6a371 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:30 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-32bbc67c-70a7-432c-a31c-98595fd6a371 Sep 09 18:23:30 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:30 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-289199a8-c880-4115-bef2-f3fd2504ad00 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-32bbc67c-70a7-432c-a31c-98595fd6a371" returned: 0 in 0.398s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-289199a8-c880-4115-bef2-f3fd2504ad00 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-quobyte-32bbc67c-70a7-432c-a31c-98595fd6a371" released by "delete_volume" :: held 0.913s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-48e70eae-7d0a-449a-aaef-983440a1a55c tempest-VolumesTransfersV355Test-121438662 None] Acquiring lock "cinder-29f22a1e-a68d-4f5f-a2d1-9388a370debf-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-48e70eae-7d0a-449a-aaef-983440a1a55c tempest-VolumesTransfersV355Test-121438662 None] Lock "cinder-29f22a1e-a68d-4f5f-a2d1-9388a370debf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:30 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-289199a8-c880-4115-bef2-f3fd2504ad00 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Created reservations ['f65bc26f-3f88-4b5e-9751-ea72bc5c4ae0', '4bfbde31-b48e-495f-8670-03f25f626ede', 'f2bd5d56-9848-4c6f-9d82-8e0e080087cb', 'cec01415-deee-4e34-bfa7-6e4ef14794c3'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-48e70eae-7d0a-449a-aaef-983440a1a55c tempest-VolumesTransfersV355Test-121438662 None] Acquiring lock "cinder-quobyte-29f22a1e-a68d-4f5f-a2d1-9388a370debf" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-48e70eae-7d0a-449a-aaef-983440a1a55c tempest-VolumesTransfersV355Test-121438662 None] Lock "cinder-quobyte-29f22a1e-a68d-4f5f-a2d1-9388a370debf" acquired by "delete_volume" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26b31f6-00dc-4fce-ac85-78aedf6337f0]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-48e70eae-7d0a-449a-aaef-983440a1a55c tempest-VolumesTransfersV355Test-121438662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-29f22a1e-a68d-4f5f-a2d1-9388a370debf {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-289199a8-c880-4115-bef2-f3fd2504ad00 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-289199a8-c880-4115-bef2-f3fd2504ad00 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-289199a8-c880-4115-bef2-f3fd2504ad00 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-289199a8-c880-4115-bef2-f3fd2504ad00 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-289199a8-c880-4115-bef2-f3fd2504ad00 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-289199a8-c880-4115-bef2-f3fd2504ad00 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:31 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:23:31 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:31 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-29f22a1e-a68d-4f5f-a2d1-9388a370debf Sep 09 18:23:31 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:31 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-289199a8-c880-4115-bef2-f3fd2504ad00 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.342s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-289199a8-c880-4115-bef2-f3fd2504ad00 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:31 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-289199a8-c880-4115-bef2-f3fd2504ad00 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Deleted volume successfully. Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-289199a8-c880-4115-bef2-f3fd2504ad00 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-32bbc67c-70a7-432c-a31c-98595fd6a371-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:31 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-48e70eae-7d0a-449a-aaef-983440a1a55c tempest-VolumesTransfersV355Test-121438662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-29f22a1e-a68d-4f5f-a2d1-9388a370debf" returned: 0 in 0.435s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-48e70eae-7d0a-449a-aaef-983440a1a55c tempest-VolumesTransfersV355Test-121438662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-29f22a1e-a68d-4f5f-a2d1-9388a370debf {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:31 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-29f22a1e-a68d-4f5f-a2d1-9388a370debf Sep 09 18:23:31 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:31 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-48e70eae-7d0a-449a-aaef-983440a1a55c tempest-VolumesTransfersV355Test-121438662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-29f22a1e-a68d-4f5f-a2d1-9388a370debf" returned: 0 in 0.282s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-48e70eae-7d0a-449a-aaef-983440a1a55c tempest-VolumesTransfersV355Test-121438662 None] Lock "cinder-quobyte-29f22a1e-a68d-4f5f-a2d1-9388a370debf" released by "delete_volume" :: held 0.786s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-48e70eae-7d0a-449a-aaef-983440a1a55c tempest-VolumesTransfersV355Test-121438662 None] Created reservations ['b774ce31-b657-46b1-a08c-551b65b32fd6', '245c9478-bc3f-43b8-8593-7afbfcd9ea91', 'f4980083-c33c-4fcb-bea4-c17787cedacb', '12b45a92-685b-48ec-9093-c3b7d9e962e0'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-48e70eae-7d0a-449a-aaef-983440a1a55c tempest-VolumesTransfersV355Test-121438662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-48e70eae-7d0a-449a-aaef-983440a1a55c tempest-VolumesTransfersV355Test-121438662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-48e70eae-7d0a-449a-aaef-983440a1a55c tempest-VolumesTransfersV355Test-121438662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-48e70eae-7d0a-449a-aaef-983440a1a55c tempest-VolumesTransfersV355Test-121438662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-48e70eae-7d0a-449a-aaef-983440a1a55c tempest-VolumesTransfersV355Test-121438662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-48e70eae-7d0a-449a-aaef-983440a1a55c tempest-VolumesTransfersV355Test-121438662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:32 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:23:32 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9dac8dc6-3630-47a4-bb27-1e6048fc6c1b tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "cinder-d53c354e-d1c5-4e04-9bb6-1808a19af0f4-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:32 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-48e70eae-7d0a-449a-aaef-983440a1a55c tempest-VolumesTransfersV355Test-121438662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.310s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:32 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-48e70eae-7d0a-449a-aaef-983440a1a55c tempest-VolumesTransfersV355Test-121438662 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9dac8dc6-3630-47a4-bb27-1e6048fc6c1b tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-d53c354e-d1c5-4e04-9bb6-1808a19af0f4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:32 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-48e70eae-7d0a-449a-aaef-983440a1a55c tempest-VolumesTransfersV355Test-121438662 None] Deleted volume successfully. Sep 09 18:23:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-48e70eae-7d0a-449a-aaef-983440a1a55c tempest-VolumesTransfersV355Test-121438662 None] Lock "cinder-29f22a1e-a68d-4f5f-a2d1-9388a370debf-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9dac8dc6-3630-47a4-bb27-1e6048fc6c1b tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "cinder-quobyte-d53c354e-d1c5-4e04-9bb6-1808a19af0f4" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9dac8dc6-3630-47a4-bb27-1e6048fc6c1b tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-quobyte-d53c354e-d1c5-4e04-9bb6-1808a19af0f4" acquired by "delete_volume" :: waited 0.020s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:32 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[5609a8f9-deba-4e75-a80c-a052b6a88227]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9dac8dc6-3630-47a4-bb27-1e6048fc6c1b tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d53c354e-d1c5-4e04-9bb6-1808a19af0f4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:32 devstack sudo[101077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d53c354e-d1c5-4e04-9bb6-1808a19af0f4 Sep 09 18:23:32 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:32 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9dac8dc6-3630-47a4-bb27-1e6048fc6c1b tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d53c354e-d1c5-4e04-9bb6-1808a19af0f4" returned: 0 in 0.468s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9dac8dc6-3630-47a4-bb27-1e6048fc6c1b tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d53c354e-d1c5-4e04-9bb6-1808a19af0f4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:32 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d53c354e-d1c5-4e04-9bb6-1808a19af0f4 Sep 09 18:23:32 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:33 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9dac8dc6-3630-47a4-bb27-1e6048fc6c1b tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d53c354e-d1c5-4e04-9bb6-1808a19af0f4" returned: 0 in 0.432s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9dac8dc6-3630-47a4-bb27-1e6048fc6c1b tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-quobyte-d53c354e-d1c5-4e04-9bb6-1808a19af0f4" released by "delete_volume" :: held 0.965s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:33 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-9dac8dc6-3630-47a4-bb27-1e6048fc6c1b tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Created reservations ['010ec384-aa2f-4d51-a74b-6e79942a6c6a', '89e578d0-dabf-4bb9-a6ea-71de90394438', 'a175c69b-e165-4c18-8a1a-39a00d36849b', '491fbd24-4323-470c-97b3-186644099570'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9dac8dc6-3630-47a4-bb27-1e6048fc6c1b tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9dac8dc6-3630-47a4-bb27-1e6048fc6c1b tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-9dac8dc6-3630-47a4-bb27-1e6048fc6c1b tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-9dac8dc6-3630-47a4-bb27-1e6048fc6c1b tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9dac8dc6-3630-47a4-bb27-1e6048fc6c1b tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9dac8dc6-3630-47a4-bb27-1e6048fc6c1b tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:33 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:23:33 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:33 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9dac8dc6-3630-47a4-bb27-1e6048fc6c1b tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.306s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:33 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-9dac8dc6-3630-47a4-bb27-1e6048fc6c1b tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:33 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-9dac8dc6-3630-47a4-bb27-1e6048fc6c1b tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Deleted volume successfully. Sep 09 18:23:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9dac8dc6-3630-47a4-bb27-1e6048fc6c1b tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-d53c354e-d1c5-4e04-9bb6-1808a19af0f4-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6dc77583-f820-47f1-ace0-29090d908862 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "cinder-4d464440-be87-4153-bfff-deeba8be375b-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6dc77583-f820-47f1-ace0-29090d908862 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-4d464440-be87-4153-bfff-deeba8be375b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6dc77583-f820-47f1-ace0-29090d908862 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "cinder-quobyte-4d464440-be87-4153-bfff-deeba8be375b" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6dc77583-f820-47f1-ace0-29090d908862 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-quobyte-4d464440-be87-4153-bfff-deeba8be375b" acquired by "delete_volume" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:34 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a8cec0-a8c4-409e-a480-ad98d9f7b720]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6dc77583-f820-47f1-ace0-29090d908862 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d464440-be87-4153-bfff-deeba8be375b {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:34 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d464440-be87-4153-bfff-deeba8be375b Sep 09 18:23:34 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:35 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6dc77583-f820-47f1-ace0-29090d908862 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d464440-be87-4153-bfff-deeba8be375b" returned: 0 in 0.409s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6dc77583-f820-47f1-ace0-29090d908862 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d464440-be87-4153-bfff-deeba8be375b {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:35 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d464440-be87-4153-bfff-deeba8be375b Sep 09 18:23:35 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:35 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-dd82fdb9-2d65-4977-b964-a2274e526cd3 req-fdf6f307-7774-4656-90b6-21731250a3bc tempest-TestInstancesWithCinderVolumes-1868759752 None] Terminate volume connection completed successfully. Sep 09 18:23:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-dd82fdb9-2d65-4977-b964-a2274e526cd3 req-fdf6f307-7774-4656-90b6-21731250a3bc tempest-TestInstancesWithCinderVolumes-1868759752 None] Deleting attachment d6d3b54b-094f-4bee-bcd1-e9c8c4f72cbc. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:23:35 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6dc77583-f820-47f1-ace0-29090d908862 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4d464440-be87-4153-bfff-deeba8be375b" returned: 0 in 0.352s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6dc77583-f820-47f1-ace0-29090d908862 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-quobyte-4d464440-be87-4153-bfff-deeba8be375b" released by "delete_volume" :: held 0.826s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:35 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-6dc77583-f820-47f1-ace0-29090d908862 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Created reservations ['334e1d68-4e1c-4255-aa76-6cfe3ba1efe7', '939a017e-0917-4f72-b6cb-762497856cf7', 'bf59c5a7-1839-4ab7-805f-09115c0e07b8', '940ef107-3762-44fc-a449-a9aa67dcbfad'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6dc77583-f820-47f1-ace0-29090d908862 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6dc77583-f820-47f1-ace0-29090d908862 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6dc77583-f820-47f1-ace0-29090d908862 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6dc77583-f820-47f1-ace0-29090d908862 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6dc77583-f820-47f1-ace0-29090d908862 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6dc77583-f820-47f1-ace0-29090d908862 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:35 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:23:35 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d0249880-35a1-4057-9bd9-484fb6be81fa tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "cinder-66fa051d-5d90-445d-b515-1a24730bdcff-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d0249880-35a1-4057-9bd9-484fb6be81fa tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-66fa051d-5d90-445d-b515-1a24730bdcff-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d0249880-35a1-4057-9bd9-484fb6be81fa tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "cinder-quobyte-66fa051d-5d90-445d-b515-1a24730bdcff" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d0249880-35a1-4057-9bd9-484fb6be81fa tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-quobyte-66fa051d-5d90-445d-b515-1a24730bdcff" acquired by "delete_volume" :: waited 0.041s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:36 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f113094-8baf-4c44-84a0-78cea751265c]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d0249880-35a1-4057-9bd9-484fb6be81fa tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66fa051d-5d90-445d-b515-1a24730bdcff {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4a38edf2-78d4-4a29-a3f6-d28b625d1182 tempest-TestInstancesWithCinderVolumes-1868759752 None] Acquiring lock "cinder-42e381b9-b926-44a8-9a62-a934f5f711d8-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4a38edf2-78d4-4a29-a3f6-d28b625d1182 tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "cinder-42e381b9-b926-44a8-9a62-a934f5f711d8-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:36 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66fa051d-5d90-445d-b515-1a24730bdcff Sep 09 18:23:36 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4a38edf2-78d4-4a29-a3f6-d28b625d1182 tempest-TestInstancesWithCinderVolumes-1868759752 None] Acquiring lock "cinder-quobyte-42e381b9-b926-44a8-9a62-a934f5f711d8" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4a38edf2-78d4-4a29-a3f6-d28b625d1182 tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "cinder-quobyte-42e381b9-b926-44a8-9a62-a934f5f711d8" acquired by "delete_volume" :: waited 0.035s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:36 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcc455d-8eec-4949-a4e8-0035ee4c2204]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a38edf2-78d4-4a29-a3f6-d28b625d1182 tempest-TestInstancesWithCinderVolumes-1868759752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-42e381b9-b926-44a8-9a62-a934f5f711d8 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:36 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6dc77583-f820-47f1-ace0-29090d908862 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.661s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:36 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-6dc77583-f820-47f1-ace0-29090d908862 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:36 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-6dc77583-f820-47f1-ace0-29090d908862 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Deleted volume successfully. Sep 09 18:23:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6dc77583-f820-47f1-ace0-29090d908862 tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-4d464440-be87-4153-bfff-deeba8be375b-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:36 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-42e381b9-b926-44a8-9a62-a934f5f711d8 Sep 09 18:23:36 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:36 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d0249880-35a1-4057-9bd9-484fb6be81fa tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66fa051d-5d90-445d-b515-1a24730bdcff" returned: 0 in 0.690s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d0249880-35a1-4057-9bd9-484fb6be81fa tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66fa051d-5d90-445d-b515-1a24730bdcff {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:36 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66fa051d-5d90-445d-b515-1a24730bdcff Sep 09 18:23:36 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:37 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a38edf2-78d4-4a29-a3f6-d28b625d1182 tempest-TestInstancesWithCinderVolumes-1868759752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-42e381b9-b926-44a8-9a62-a934f5f711d8" returned: 0 in 0.785s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a38edf2-78d4-4a29-a3f6-d28b625d1182 tempest-TestInstancesWithCinderVolumes-1868759752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-42e381b9-b926-44a8-9a62-a934f5f711d8 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:37 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d0249880-35a1-4057-9bd9-484fb6be81fa tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-66fa051d-5d90-445d-b515-1a24730bdcff" returned: 0 in 0.511s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d0249880-35a1-4057-9bd9-484fb6be81fa tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-quobyte-66fa051d-5d90-445d-b515-1a24730bdcff" released by "delete_volume" :: held 1.288s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:37 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-42e381b9-b926-44a8-9a62-a934f5f711d8 Sep 09 18:23:37 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:37 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-d0249880-35a1-4057-9bd9-484fb6be81fa tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Created reservations ['e1c79f67-08a9-4162-ba03-8772123c1993', '92d3cfb6-54ce-4e10-ab4a-c01b06411238', '7f51a785-0445-4abe-a9b5-736bf4af0d7d', '36f3369f-4118-40c8-b4e4-728da12bd581'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d0249880-35a1-4057-9bd9-484fb6be81fa tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d0249880-35a1-4057-9bd9-484fb6be81fa tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d0249880-35a1-4057-9bd9-484fb6be81fa tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d0249880-35a1-4057-9bd9-484fb6be81fa tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d0249880-35a1-4057-9bd9-484fb6be81fa tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d0249880-35a1-4057-9bd9-484fb6be81fa tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:37 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:23:37 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:37 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a38edf2-78d4-4a29-a3f6-d28b625d1182 tempest-TestInstancesWithCinderVolumes-1868759752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-42e381b9-b926-44a8-9a62-a934f5f711d8" returned: 0 in 0.427s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4a38edf2-78d4-4a29-a3f6-d28b625d1182 tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "cinder-quobyte-42e381b9-b926-44a8-9a62-a934f5f711d8" released by "delete_volume" :: held 1.271s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:37 devstack cinder-volume[87639]: WARNING cinder.quota [None req-4a38edf2-78d4-4a29-a3f6-d28b625d1182 tempest-TestInstancesWithCinderVolumes-1868759752 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-6183945-1078498992 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-6183945-1078498992, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:23:37 devstack cinder-volume[87639]: WARNING cinder.quota [None req-4a38edf2-78d4-4a29-a3f6-d28b625d1182 tempest-TestInstancesWithCinderVolumes-1868759752 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-6183945-1078498992 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-6183945-1078498992, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:23:37 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-4a38edf2-78d4-4a29-a3f6-d28b625d1182 tempest-TestInstancesWithCinderVolumes-1868759752 None] Created reservations ['9d573bc3-75c6-4ac8-8da9-ea07951d4b90', '832b78dd-c53d-42c9-9367-61591d146d99', 'e69d8e4c-0c0f-4731-99e8-8338cf032040', '1203a71e-7d70-4394-9dd2-444ea6361d5c'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4a38edf2-78d4-4a29-a3f6-d28b625d1182 tempest-TestInstancesWithCinderVolumes-1868759752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4a38edf2-78d4-4a29-a3f6-d28b625d1182 tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4a38edf2-78d4-4a29-a3f6-d28b625d1182 tempest-TestInstancesWithCinderVolumes-1868759752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4a38edf2-78d4-4a29-a3f6-d28b625d1182 tempest-TestInstancesWithCinderVolumes-1868759752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4a38edf2-78d4-4a29-a3f6-d28b625d1182 tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a38edf2-78d4-4a29-a3f6-d28b625d1182 tempest-TestInstancesWithCinderVolumes-1868759752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:38 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:38 devstack sudo[101153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:23:38 devstack sudo[101153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d0249880-35a1-4057-9bd9-484fb6be81fa tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.415s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:38 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-d0249880-35a1-4057-9bd9-484fb6be81fa tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:38 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d0249880-35a1-4057-9bd9-484fb6be81fa tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Deleted volume successfully. Sep 09 18:23:38 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d0249880-35a1-4057-9bd9-484fb6be81fa tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-66fa051d-5d90-445d-b515-1a24730bdcff-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:38 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0849e379-44dd-4a6b-b453-898d025740cc tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "cinder-23f5399d-6b89-45c5-a2da-ae1baee979d4-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:38 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0849e379-44dd-4a6b-b453-898d025740cc tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-23f5399d-6b89-45c5-a2da-ae1baee979d4-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:38 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0849e379-44dd-4a6b-b453-898d025740cc tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "cinder-quobyte-23f5399d-6b89-45c5-a2da-ae1baee979d4" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:38 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0849e379-44dd-4a6b-b453-898d025740cc tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-quobyte-23f5399d-6b89-45c5-a2da-ae1baee979d4" acquired by "delete_volume" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:38 devstack sudo[101153]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4a38edf2-78d4-4a29-a3f6-d28b625d1182 tempest-TestInstancesWithCinderVolumes-1868759752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.577s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:38 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-4a38edf2-78d4-4a29-a3f6-d28b625d1182 tempest-TestInstancesWithCinderVolumes-1868759752 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:38 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-4a38edf2-78d4-4a29-a3f6-d28b625d1182 tempest-TestInstancesWithCinderVolumes-1868759752 None] Deleted volume successfully. Sep 09 18:23:38 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b9acef-8951-4afe-9787-d8c25f4b7a09]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0849e379-44dd-4a6b-b453-898d025740cc tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-23f5399d-6b89-45c5-a2da-ae1baee979d4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:38 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4a38edf2-78d4-4a29-a3f6-d28b625d1182 tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "cinder-42e381b9-b926-44a8-9a62-a934f5f711d8-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:38 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-23f5399d-6b89-45c5-a2da-ae1baee979d4 Sep 09 18:23:38 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:39 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0849e379-44dd-4a6b-b453-898d025740cc tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-23f5399d-6b89-45c5-a2da-ae1baee979d4" returned: 0 in 0.626s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0849e379-44dd-4a6b-b453-898d025740cc tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-23f5399d-6b89-45c5-a2da-ae1baee979d4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:39 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-23f5399d-6b89-45c5-a2da-ae1baee979d4 Sep 09 18:23:39 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:39 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0849e379-44dd-4a6b-b453-898d025740cc tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-23f5399d-6b89-45c5-a2da-ae1baee979d4" returned: 0 in 0.399s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:39 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0849e379-44dd-4a6b-b453-898d025740cc tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-quobyte-23f5399d-6b89-45c5-a2da-ae1baee979d4" released by "delete_volume" :: held 1.103s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:39 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-0849e379-44dd-4a6b-b453-898d025740cc tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Created reservations ['0a68cd1e-7307-48f6-a54d-b3a4134f5a0d', '9ea2d984-82d4-498c-a6b5-158b1af2cff6', '113a95c8-da7e-49e3-af9c-dc6d5cac0b04', 'c9b5fc21-286b-4e51-b9aa-2b36861edb3e'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0849e379-44dd-4a6b-b453-898d025740cc tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0849e379-44dd-4a6b-b453-898d025740cc tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0849e379-44dd-4a6b-b453-898d025740cc tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0849e379-44dd-4a6b-b453-898d025740cc tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0849e379-44dd-4a6b-b453-898d025740cc tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0849e379-44dd-4a6b-b453-898d025740cc tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:39 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:23:39 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:40 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0849e379-44dd-4a6b-b453-898d025740cc tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.332s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:40 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-0849e379-44dd-4a6b-b453-898d025740cc tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:40 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-0849e379-44dd-4a6b-b453-898d025740cc tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Deleted volume successfully. Sep 09 18:23:40 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0849e379-44dd-4a6b-b453-898d025740cc tempest-CreateVolumesFromSourceVolumeTest-2046062588 None] Lock "cinder-23f5399d-6b89-45c5-a2da-ae1baee979d4-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:41 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-7ba8ed82-c18e-4ec6-99e3-ed6ad3300d72 req-18f96730-76e3-4769-971b-bc8008c1a93e tempest-TestInstancesWithCinderVolumes-1868759752 None] Terminate volume connection completed successfully. Sep 09 18:23:41 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-7ba8ed82-c18e-4ec6-99e3-ed6ad3300d72 req-18f96730-76e3-4769-971b-bc8008c1a93e tempest-TestInstancesWithCinderVolumes-1868759752 None] Deleting attachment d0bd12ee-e322-42a7-9e6a-448fdfc0d2b4. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:23:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-707149a5-d7fe-4584-bc39-44d13989babc tempest-TestInstancesWithCinderVolumes-1868759752 None] Acquiring lock "cinder-b5e172a0-53cb-4e1c-8442-5da62b913e38-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-707149a5-d7fe-4584-bc39-44d13989babc tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "cinder-b5e172a0-53cb-4e1c-8442-5da62b913e38-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-707149a5-d7fe-4584-bc39-44d13989babc tempest-TestInstancesWithCinderVolumes-1868759752 None] Acquiring lock "cinder-quobyte-b5e172a0-53cb-4e1c-8442-5da62b913e38" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-707149a5-d7fe-4584-bc39-44d13989babc tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "cinder-quobyte-b5e172a0-53cb-4e1c-8442-5da62b913e38" acquired by "delete_volume" :: waited 0.032s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:42 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[604fc113-417c-4957-9fb5-0247bd54835e]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-707149a5-d7fe-4584-bc39-44d13989babc tempest-TestInstancesWithCinderVolumes-1868759752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5e172a0-53cb-4e1c-8442-5da62b913e38 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:42 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5e172a0-53cb-4e1c-8442-5da62b913e38 Sep 09 18:23:42 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:42 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-707149a5-d7fe-4584-bc39-44d13989babc tempest-TestInstancesWithCinderVolumes-1868759752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5e172a0-53cb-4e1c-8442-5da62b913e38" returned: 0 in 0.505s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-707149a5-d7fe-4584-bc39-44d13989babc tempest-TestInstancesWithCinderVolumes-1868759752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5e172a0-53cb-4e1c-8442-5da62b913e38 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:42 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5e172a0-53cb-4e1c-8442-5da62b913e38 Sep 09 18:23:42 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:43 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-707149a5-d7fe-4584-bc39-44d13989babc tempest-TestInstancesWithCinderVolumes-1868759752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b5e172a0-53cb-4e1c-8442-5da62b913e38" returned: 0 in 0.324s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-707149a5-d7fe-4584-bc39-44d13989babc tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "cinder-quobyte-b5e172a0-53cb-4e1c-8442-5da62b913e38" released by "delete_volume" :: held 0.916s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:43 devstack cinder-volume[87639]: WARNING cinder.quota [None req-707149a5-d7fe-4584-bc39-44d13989babc tempest-TestInstancesWithCinderVolumes-1868759752 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-480405817-666919565 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-480405817-666919565, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:23:43 devstack cinder-volume[87639]: WARNING cinder.quota [None req-707149a5-d7fe-4584-bc39-44d13989babc tempest-TestInstancesWithCinderVolumes-1868759752 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-480405817-666919565 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-480405817-666919565, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:43 devstack sudo[101199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:23:43 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-707149a5-d7fe-4584-bc39-44d13989babc tempest-TestInstancesWithCinderVolumes-1868759752 None] Created reservations ['07a289a1-ad62-4b66-9eee-5ffb140e3f8d', '0b781a24-cc3d-4203-a5c5-57b406a1330d', '5bd5bb2b-8544-4f8c-a560-b614f49b5493', '3a72c8f1-6c36-4da8-9e9d-b5e1a87976cc'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-707149a5-d7fe-4584-bc39-44d13989babc tempest-TestInstancesWithCinderVolumes-1868759752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-707149a5-d7fe-4584-bc39-44d13989babc tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-707149a5-d7fe-4584-bc39-44d13989babc tempest-TestInstancesWithCinderVolumes-1868759752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-707149a5-d7fe-4584-bc39-44d13989babc tempest-TestInstancesWithCinderVolumes-1868759752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-707149a5-d7fe-4584-bc39-44d13989babc tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-707149a5-d7fe-4584-bc39-44d13989babc tempest-TestInstancesWithCinderVolumes-1868759752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:43 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:23:43 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:43 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.416s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 29 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:23:43 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-707149a5-d7fe-4584-bc39-44d13989babc tempest-TestInstancesWithCinderVolumes-1868759752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.344s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-707149a5-d7fe-4584-bc39-44d13989babc tempest-TestInstancesWithCinderVolumes-1868759752 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:43 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-707149a5-d7fe-4584-bc39-44d13989babc tempest-TestInstancesWithCinderVolumes-1868759752 None] Deleted volume successfully. Sep 09 18:23:43 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-707149a5-d7fe-4584-bc39-44d13989babc tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "cinder-b5e172a0-53cb-4e1c-8442-5da62b913e38-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:45 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:23:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Flow 'volume_create_manager' (ffee2520-bfb5-4888-b373-e0de0943aa1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b06165-876d-4cce-9ffa-19b3ebdd180c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53b06165-876d-4cce-9ffa-19b3ebdd180c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1800964088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1754b7be-47b0-40a6-9a90-888d70c94fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36592aa405548dfbbeb629cffeb154b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:46Z,use_quota=True,user_id='7e5a7529f57944f698ceb9121067a026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b5756e-6ce4-47b8-9957-ec5ec8f3f42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b5756e-6ce4-47b8-9957-ec5ec8f3f42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e391e7-4ef4-4525-8b4a-f10e009e1dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:46 devstack cinder-volume[87639]: DEBUG cinder.image.glance [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Creating Keystone auth plugin from conf {{(pid=87639) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 18:23:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e391e7-4ef4-4525-8b4a-f10e009e1dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1754b7be-47b0-40a6-9a90-888d70c94fb6', 'volume_name': 'volume-1754b7be-47b0-40a6-9a90-888d70c94fb6', 'volume_size': 1, 'image_id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7ff1e5c089804fe694a8f7d1bf0a7374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'created_at': datetime.datetime(2026, 9, 9, 16, 5, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 5, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c559dd6d-a202-48fb-a59a-bd41b36e8c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c559dd6d-a202-48fb-a59a-bd41b36e8c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6d8b58-bde4-4b23-b153-a4bcc6fc3bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:46 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Volume 1754b7be-47b0-40a6-9a90-888d70c94fb6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1754b7be-47b0-40a6-9a90-888d70c94fb6', 'volume_size': 1, 'image_id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7ff1e5c089804fe694a8f7d1bf0a7374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'created_at': datetime.datetime(2026, 9, 9, 16, 5, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 5, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 18:23:46 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Trying to clone 1754b7be-47b0-40a6-9a90-888d70c94fb6 from image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}]). {{(pid=87639) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_76vb8kfxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 18:23:47 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Image download 20.69 MB at 20.69 MB/s Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1b44a2-139a-43d9-8851-c0c97f74cdcf]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_76vb8kfxdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:47 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_76vb8kfxdevstack@QuobyteHD Sep 09 18:23:47 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:47 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-00575299-f29b-4d6a-b7d7-169d6a7cbdc1 req-690c36e2-becb-422a-92e8-6699550f23c9 tempest-TestInstancesWithCinderVolumes-1868759752 None] Terminate volume connection completed successfully. Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-00575299-f29b-4d6a-b7d7-169d6a7cbdc1 req-690c36e2-becb-422a-92e8-6699550f23c9 tempest-TestInstancesWithCinderVolumes-1868759752 None] Deleting attachment f1d9ed32-57dc-4178-95e7-276ca19c9376. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:23:47 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_76vb8kfxdevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Temporary image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 is fetched for user 7e5a7529f57944f698ceb9121067a026. {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Flow 'volume_create_manager' (dd1057e4-d10f-4b08-9aca-044abb21badb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2963ee0c-827b-4cfc-8e17-819ade8ff5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2963ee0c-827b-4cfc-8e17-819ade8ff5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-105003918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94705b19-1a34-41da-a0a0-92ba6823c4c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a8f4f5c03042439e7ffdd8520d6818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:48Z,use_quota=True,user_id='52fdd576fad943f289a766776d848722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1fb574-96e1-42c6-a02f-e175bde0ee9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a1fb574-96e1-42c6-a02f-e175bde0ee9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e157c6-8465-4c0c-b943-3295ca7f73da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58e157c6-8465-4c0c-b943-3295ca7f73da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94705b19-1a34-41da-a0a0-92ba6823c4c1', 'volume_name': 'volume-94705b19-1a34-41da-a0a0-92ba6823c4c1', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5bf64e-19b7-47ef-bca3-532dc0c60ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c5bf64e-19b7-47ef-bca3-532dc0c60ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd8f3f4-8402-4f24-99e1-1d428c1b8a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:47 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Volume 94705b19-1a34-41da-a0a0-92ba6823c4c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94705b19-1a34-41da-a0a0-92ba6823c4c1', 'volume_size': 1} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-105003918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94705b19-1a34-41da-a0a0-92ba6823c4c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a8f4f5c03042439e7ffdd8520d6818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:48Z,use_quota=True,user_id='52fdd576fad943f289a766776d848722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Creating volume 94705b19-1a34-41da-a0a0-92ba6823c4c1 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:23:47 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-94705b19-1a34-41da-a0a0-92ba6823c4c1 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:47 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-94705b19-1a34-41da-a0a0-92ba6823c4c1 1073741824 Sep 09 18:23:47 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d481497-07ae-48b8-a96f-88ce711e05ae]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_76vb8kfxdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:47 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_76vb8kfxdevstack@QuobyteHD Sep 09 18:23:47 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:48 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_76vb8kfxdevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-25cef5e9-fe7f-4e79-8b78-c327d2118e43 tempest-TestInstancesWithCinderVolumes-1868759752 None] Acquiring lock "cinder-2aa0ce66-642c-4f68-94cd-736e34ef801e-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-25cef5e9-fe7f-4e79-8b78-c327d2118e43 tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "cinder-2aa0ce66-642c-4f68-94cd-736e34ef801e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:48 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-94705b19-1a34-41da-a0a0-92ba6823c4c1 1073741824" returned: 0 in 0.676s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-25cef5e9-fe7f-4e79-8b78-c327d2118e43 tempest-TestInstancesWithCinderVolumes-1868759752 None] Acquiring lock "cinder-quobyte-2aa0ce66-642c-4f68-94cd-736e34ef801e" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-25cef5e9-fe7f-4e79-8b78-c327d2118e43 tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "cinder-quobyte-2aa0ce66-642c-4f68-94cd-736e34ef801e" acquired by "delete_volume" :: waited 0.043s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-94705b19-1a34-41da-a0a0-92ba6823c4c1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a5d701-0e7b-4e78-af14-dfabb5fe388d]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-25cef5e9-fe7f-4e79-8b78-c327d2118e43 tempest-TestInstancesWithCinderVolumes-1868759752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2aa0ce66-642c-4f68-94cd-736e34ef801e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:48 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-94705b19-1a34-41da-a0a0-92ba6823c4c1 Sep 09 18:23:48 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:48 devstack sudo[101257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2aa0ce66-642c-4f68-94cd-736e34ef801e Sep 09 18:23:48 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:48 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-94705b19-1a34-41da-a0a0-92ba6823c4c1" returned: 0 in 0.277s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.516s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1800964088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1754b7be-47b0-40a6-9a90-888d70c94fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36592aa405548dfbbeb629cffeb154b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:46Z,use_quota=True,user_id='7e5a7529f57944f698ceb9121067a026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Creating volume 1754b7be-47b0-40a6-9a90-888d70c94fb6 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:23:48 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd8f3f4-8402-4f24-99e1-1d428c1b8a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94705b19-1a34-41da-a0a0-92ba6823c4c1', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d26d9bf-e364-4822-9968-f3c70f62eae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:48 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6 1073741824 Sep 09 18:23:48 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:48 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Volume volume-94705b19-1a34-41da-a0a0-92ba6823c4c1 (94705b19-1a34-41da-a0a0-92ba6823c4c1): created successfully Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d26d9bf-e364-4822-9968-f3c70f62eae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Flow 'volume_create_manager' (dd1057e4-d10f-4b08-9aca-044abb21badb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:48 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d7fd7eac-0971-4f01-9678-934840c02512 tempest-ProjectReaderTests-154902682 None] Created volume successfully. Sep 09 18:23:48 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-25cef5e9-fe7f-4e79-8b78-c327d2118e43 tempest-TestInstancesWithCinderVolumes-1868759752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2aa0ce66-642c-4f68-94cd-736e34ef801e" returned: 0 in 0.418s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-25cef5e9-fe7f-4e79-8b78-c327d2118e43 tempest-TestInstancesWithCinderVolumes-1868759752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2aa0ce66-642c-4f68-94cd-736e34ef801e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:48 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2aa0ce66-642c-4f68-94cd-736e34ef801e Sep 09 18:23:48 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:49 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-25cef5e9-fe7f-4e79-8b78-c327d2118e43 tempest-TestInstancesWithCinderVolumes-1868759752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2aa0ce66-642c-4f68-94cd-736e34ef801e" returned: 0 in 0.287s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-25cef5e9-fe7f-4e79-8b78-c327d2118e43 tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "cinder-quobyte-2aa0ce66-642c-4f68-94cd-736e34ef801e" released by "delete_volume" :: held 0.770s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:49 devstack cinder-volume[87639]: WARNING cinder.quota [None req-25cef5e9-fe7f-4e79-8b78-c327d2118e43 tempest-TestInstancesWithCinderVolumes-1868759752 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1971587475-1670262811 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1971587475-1670262811, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:23:49 devstack cinder-volume[87639]: WARNING cinder.quota [None req-25cef5e9-fe7f-4e79-8b78-c327d2118e43 tempest-TestInstancesWithCinderVolumes-1868759752 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1971587475-1670262811 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1971587475-1670262811, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:23:49 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-25cef5e9-fe7f-4e79-8b78-c327d2118e43 tempest-TestInstancesWithCinderVolumes-1868759752 None] Created reservations ['457a45f0-1273-41f2-a2bc-95a979e8915c', 'c51c76b2-483c-4b76-8e82-d90096b55109', 'f4b99b8f-4d28-4e30-84a9-e83b8e9581ed', '8fab6672-2c5c-432c-a24c-86fd16fcc1fa'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:49 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6 1073741824" returned: 0 in 0.569s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-25cef5e9-fe7f-4e79-8b78-c327d2118e43 tempest-TestInstancesWithCinderVolumes-1868759752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-25cef5e9-fe7f-4e79-8b78-c327d2118e43 tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:49 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-25cef5e9-fe7f-4e79-8b78-c327d2118e43 tempest-TestInstancesWithCinderVolumes-1868759752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:49 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6 Sep 09 18:23:49 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:49 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-25cef5e9-fe7f-4e79-8b78-c327d2118e43 tempest-TestInstancesWithCinderVolumes-1868759752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-25cef5e9-fe7f-4e79-8b78-c327d2118e43 tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-25cef5e9-fe7f-4e79-8b78-c327d2118e43 tempest-TestInstancesWithCinderVolumes-1868759752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:49 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:23:49 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:49 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6" returned: 0 in 0.373s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:49 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:23:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:49 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Attempting download of 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 ((None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}])) to volume 1754b7be-47b0-40a6-9a90-888d70c94fb6. {{(pid=87639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 18:23:49 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-25cef5e9-fe7f-4e79-8b78-c327d2118e43 tempest-TestInstancesWithCinderVolumes-1868759752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.433s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:49 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-25cef5e9-fe7f-4e79-8b78-c327d2118e43 tempest-TestInstancesWithCinderVolumes-1868759752 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:49 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-25cef5e9-fe7f-4e79-8b78-c327d2118e43 tempest-TestInstancesWithCinderVolumes-1868759752 None] Deleted volume successfully. Sep 09 18:23:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-25cef5e9-fe7f-4e79-8b78-c327d2118e43 tempest-TestInstancesWithCinderVolumes-1868759752 None] Lock "cinder-2aa0ce66-642c-4f68-94cd-736e34ef801e-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:50 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2d3372-90e2-49fc-8841-9d1ce148a5b3]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_jeh_5oo4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1a5a4c6f-2941-4069-843d-b98a6abca543 tempest-ProjectReaderTests-154902682 None] Acquiring lock "cinder-94705b19-1a34-41da-a0a0-92ba6823c4c1-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:50 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_jeh_5oo4 Sep 09 18:23:50 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1a5a4c6f-2941-4069-843d-b98a6abca543 tempest-ProjectReaderTests-154902682 None] Lock "cinder-94705b19-1a34-41da-a0a0-92ba6823c4c1-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1a5a4c6f-2941-4069-843d-b98a6abca543 tempest-ProjectReaderTests-154902682 None] Acquiring lock "cinder-quobyte-94705b19-1a34-41da-a0a0-92ba6823c4c1" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1a5a4c6f-2941-4069-843d-b98a6abca543 tempest-ProjectReaderTests-154902682 None] Lock "cinder-quobyte-94705b19-1a34-41da-a0a0-92ba6823c4c1" acquired by "delete_volume" :: waited 0.037s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:50 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3b1c66-f84e-4935-9b44-8fa17f0d888c]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1a5a4c6f-2941-4069-843d-b98a6abca543 tempest-ProjectReaderTests-154902682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-94705b19-1a34-41da-a0a0-92ba6823c4c1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:50 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_jeh_5oo4" returned: 0 in 0.664s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_jeh_5oo4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:50 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-94705b19-1a34-41da-a0a0-92ba6823c4c1 Sep 09 18:23:50 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:50 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_jeh_5oo4 Sep 09 18:23:50 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:51 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1a5a4c6f-2941-4069-843d-b98a6abca543 tempest-ProjectReaderTests-154902682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-94705b19-1a34-41da-a0a0-92ba6823c4c1" returned: 0 in 0.566s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1a5a4c6f-2941-4069-843d-b98a6abca543 tempest-ProjectReaderTests-154902682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-94705b19-1a34-41da-a0a0-92ba6823c4c1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:51 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-94705b19-1a34-41da-a0a0-92ba6823c4c1 Sep 09 18:23:51 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:51 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_jeh_5oo4" returned: 1 in 0.551s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_jeh_5oo4' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:23:51 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6170efe0-a614-4fbe-84f7-6d797109de96]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_76vb8kfxdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:51 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_76vb8kfxdevstack@QuobyteHD Sep 09 18:23:51 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:51 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1a5a4c6f-2941-4069-843d-b98a6abca543 tempest-ProjectReaderTests-154902682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-94705b19-1a34-41da-a0a0-92ba6823c4c1" returned: 0 in 0.495s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1a5a4c6f-2941-4069-843d-b98a6abca543 tempest-ProjectReaderTests-154902682 None] Lock "cinder-quobyte-94705b19-1a34-41da-a0a0-92ba6823c4c1" released by "delete_volume" :: held 1.157s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:51 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_76vb8kfxdevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:51 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 was qcow2, converting to qcow2 {{(pid=87639) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 18:23:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_76vb8kfxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:51 devstack sudo[101310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_76vb8kfxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6 Sep 09 18:23:51 devstack sudo[101310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:51 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-1a5a4c6f-2941-4069-843d-b98a6abca543 tempest-ProjectReaderTests-154902682 None] Created reservations ['034df368-5f53-4224-b865-47f9e7ab5f97', '7623b21e-da6f-4559-ac4b-ebb801eb2177', 'e7bfee5d-e5e0-45f6-a37e-2be4d08a17c8', 'ee0fd0ba-a3a9-48ae-bbaa-3523fe9e2011'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1a5a4c6f-2941-4069-843d-b98a6abca543 tempest-ProjectReaderTests-154902682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1a5a4c6f-2941-4069-843d-b98a6abca543 tempest-ProjectReaderTests-154902682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1a5a4c6f-2941-4069-843d-b98a6abca543 tempest-ProjectReaderTests-154902682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1a5a4c6f-2941-4069-843d-b98a6abca543 tempest-ProjectReaderTests-154902682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1a5a4c6f-2941-4069-843d-b98a6abca543 tempest-ProjectReaderTests-154902682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1a5a4c6f-2941-4069-843d-b98a6abca543 tempest-ProjectReaderTests-154902682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:51 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:23:51 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:52 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1a5a4c6f-2941-4069-843d-b98a6abca543 tempest-ProjectReaderTests-154902682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.521s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:52 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-1a5a4c6f-2941-4069-843d-b98a6abca543 tempest-ProjectReaderTests-154902682 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:52 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-1a5a4c6f-2941-4069-843d-b98a6abca543 tempest-ProjectReaderTests-154902682 None] Deleted volume successfully. Sep 09 18:23:52 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1a5a4c6f-2941-4069-843d-b98a6abca543 tempest-ProjectReaderTests-154902682 None] Lock "cinder-94705b19-1a34-41da-a0a0-92ba6823c4c1-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:53 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:23:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Flow 'volume_create_manager' (61405528-00a9-472c-9031-b7922db2dfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (511b6d30-888f-4d1c-bed8-18894aa99503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (511b6d30-888f-4d1c-bed8-18894aa99503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-566300433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab9208a-6723-4181-a3ec-a2aaa72f81a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a8f4f5c03042439e7ffdd8520d6818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:53Z,use_quota=True,user_id='52fdd576fad943f289a766776d848722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e031f5a0-59b7-4a1e-97f8-9761c9b57f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e031f5a0-59b7-4a1e-97f8-9761c9b57f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f615629-878a-4333-99b6-3b5768591797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f615629-878a-4333-99b6-3b5768591797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fab9208a-6723-4181-a3ec-a2aaa72f81a6', 'volume_name': 'volume-fab9208a-6723-4181-a3ec-a2aaa72f81a6', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe6f1735-6ed6-429b-a46d-a50a9f473c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe6f1735-6ed6-429b-a46d-a50a9f473c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab9cef3-91ff-4df2-9000-9876199bd0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:53 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Volume fab9208a-6723-4181-a3ec-a2aaa72f81a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fab9208a-6723-4181-a3ec-a2aaa72f81a6', 'volume_size': 1} Sep 09 18:23:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-566300433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fab9208a-6723-4181-a3ec-a2aaa72f81a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0a8f4f5c03042439e7ffdd8520d6818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:23:53Z,use_quota=True,user_id='52fdd576fad943f289a766776d848722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:23:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Creating volume fab9208a-6723-4181-a3ec-a2aaa72f81a6 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:23:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:23:53 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:23:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fab9208a-6723-4181-a3ec-a2aaa72f81a6 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:53 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fab9208a-6723-4181-a3ec-a2aaa72f81a6 1073741824 Sep 09 18:23:53 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:54 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fab9208a-6723-4181-a3ec-a2aaa72f81a6 1073741824" returned: 0 in 0.778s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fab9208a-6723-4181-a3ec-a2aaa72f81a6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:54 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fab9208a-6723-4181-a3ec-a2aaa72f81a6 Sep 09 18:23:54 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:54 devstack sudo[101310]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_76vb8kfxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6" returned: 0 in 2.885s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:54 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_76vb8kfxdevstack@QuobyteHD, size 112.00 MB, duration 2.89 sec, destination /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6 {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:23:54 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Converted 112.00 MB image at 38.81 MB/s Sep 09 18:23:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:54 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:54 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6 1G Sep 09 18:23:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fab9208a-6723-4181-a3ec-a2aaa72f81a6" returned: 0 in 0.436s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:54 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:23:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab9cef3-91ff-4df2-9000-9876199bd0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fab9208a-6723-4181-a3ec-a2aaa72f81a6', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da720e33-abf6-4fc3-ac04-0caca0bafae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:54 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Volume volume-fab9208a-6723-4181-a3ec-a2aaa72f81a6 (fab9208a-6723-4181-a3ec-a2aaa72f81a6): created successfully Sep 09 18:23:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da720e33-abf6-4fc3-ac04-0caca0bafae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Flow 'volume_create_manager' (61405528-00a9-472c-9031-b7922db2dfdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:54 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-18b507dd-da22-4f3b-834e-a162bd447ed5 tempest-ProjectReaderTests-154902682 None] Created volume successfully. Sep 09 18:23:55 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6 1G" returned: 0 in 0.574s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:55 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Downloaded image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 ((None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}])) to volume 1754b7be-47b0-40a6-9a90-888d70c94fb6 successfully. {{(pid=87639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 18:23:55 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Temporary image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 for user 7e5a7529f57944f698ceb9121067a026 is deleted. {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 18:23:55 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Marking volume 1754b7be-47b0-40a6-9a90-888d70c94fb6 as bootable. {{(pid=87639) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 18:23:55 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Copying metadata from image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 to 1754b7be-47b0-40a6-9a90-888d70c94fb6. {{(pid=87639) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 18:23:55 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Creating volume glance metadata for volume 1754b7be-47b0-40a6-9a90-888d70c94fb6 backed by image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87639) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 18:23:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6d8b58-bde4-4b23-b153-a4bcc6fc3bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1754b7be-47b0-40a6-9a90-888d70c94fb6', 'volume_size': 1, 'image_id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7ff1e5c089804fe694a8f7d1bf0a7374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'created_at': datetime.datetime(2026, 9, 9, 16, 5, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 5, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ebcc71-202a-4b35-af7b-accf11b8df91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:23:55 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Volume volume-1754b7be-47b0-40a6-9a90-888d70c94fb6 (1754b7be-47b0-40a6-9a90-888d70c94fb6): created successfully Sep 09 18:23:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ebcc71-202a-4b35-af7b-accf11b8df91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:23:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Flow 'volume_create_manager' (ffee2520-bfb5-4888-b373-e0de0943aa1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:23:55 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-74d5737c-35d6-450a-ba14-dfb80910f2a4 tempest-VolumesExtendTest-1907060485 None] Created volume successfully. Sep 09 18:23:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f7412018-a58f-48c6-8729-9bf86fc80476 tempest-ProjectReaderTests-154902682 None] Acquiring lock "cinder-fab9208a-6723-4181-a3ec-a2aaa72f81a6-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f7412018-a58f-48c6-8729-9bf86fc80476 tempest-ProjectReaderTests-154902682 None] Lock "cinder-fab9208a-6723-4181-a3ec-a2aaa72f81a6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f7412018-a58f-48c6-8729-9bf86fc80476 tempest-ProjectReaderTests-154902682 None] Acquiring lock "cinder-quobyte-fab9208a-6723-4181-a3ec-a2aaa72f81a6" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f7412018-a58f-48c6-8729-9bf86fc80476 tempest-ProjectReaderTests-154902682 None] Lock "cinder-quobyte-fab9208a-6723-4181-a3ec-a2aaa72f81a6" acquired by "delete_volume" :: waited 0.026s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:55 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8592ef65-f985-45b9-a3cc-f4d351a6385f]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f7412018-a58f-48c6-8729-9bf86fc80476 tempest-ProjectReaderTests-154902682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fab9208a-6723-4181-a3ec-a2aaa72f81a6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:55 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fab9208a-6723-4181-a3ec-a2aaa72f81a6 Sep 09 18:23:55 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-525c09f6-b2b1-4ee9-8f84-3c73eb0a6c5e tempest-VolumesExtendTest-1907060485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-525c09f6-b2b1-4ee9-8f84-3c73eb0a6c5e tempest-VolumesExtendTest-1907060485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:55 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1802c9a-ab9e-4158-90d7-f7fc5c2c4b32]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-525c09f6-b2b1-4ee9-8f84-3c73eb0a6c5e tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:56 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6 Sep 09 18:23:56 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:56 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f7412018-a58f-48c6-8729-9bf86fc80476 tempest-ProjectReaderTests-154902682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fab9208a-6723-4181-a3ec-a2aaa72f81a6" returned: 0 in 0.663s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f7412018-a58f-48c6-8729-9bf86fc80476 tempest-ProjectReaderTests-154902682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fab9208a-6723-4181-a3ec-a2aaa72f81a6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:56 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fab9208a-6723-4181-a3ec-a2aaa72f81a6 Sep 09 18:23:56 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:56 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-525c09f6-b2b1-4ee9-8f84-3c73eb0a6c5e tempest-VolumesExtendTest-1907060485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6" returned: 0 in 0.744s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-525c09f6-b2b1-4ee9-8f84-3c73eb0a6c5e tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6 2G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:56 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f7412018-a58f-48c6-8729-9bf86fc80476 tempest-ProjectReaderTests-154902682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fab9208a-6723-4181-a3ec-a2aaa72f81a6" returned: 0 in 0.423s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:56 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f7412018-a58f-48c6-8729-9bf86fc80476 tempest-ProjectReaderTests-154902682 None] Lock "cinder-quobyte-fab9208a-6723-4181-a3ec-a2aaa72f81a6" released by "delete_volume" :: held 1.151s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-525c09f6-b2b1-4ee9-8f84-3c73eb0a6c5e tempest-VolumesExtendTest-1907060485 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6 2G" returned: 0 in 0.127s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-525c09f6-b2b1-4ee9-8f84-3c73eb0a6c5e tempest-VolumesExtendTest-1907060485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.953s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:56 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-f7412018-a58f-48c6-8729-9bf86fc80476 tempest-ProjectReaderTests-154902682 None] Created reservations ['779b0cea-b486-42b1-8691-de995b1b34bd', '280557f7-bed8-4973-a646-ee3264a0c9aa', 'f5c6537f-f0a4-4d03-b981-f2f19e7b437d', '0aaf4846-8f3d-46ba-82ee-b0d77f3f7586'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:56 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-525c09f6-b2b1-4ee9-8f84-3c73eb0a6c5e tempest-VolumesExtendTest-1907060485 None] Extend volume completed successfully. Sep 09 18:23:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f7412018-a58f-48c6-8729-9bf86fc80476 tempest-ProjectReaderTests-154902682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f7412018-a58f-48c6-8729-9bf86fc80476 tempest-ProjectReaderTests-154902682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f7412018-a58f-48c6-8729-9bf86fc80476 tempest-ProjectReaderTests-154902682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f7412018-a58f-48c6-8729-9bf86fc80476 tempest-ProjectReaderTests-154902682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f7412018-a58f-48c6-8729-9bf86fc80476 tempest-ProjectReaderTests-154902682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f7412018-a58f-48c6-8729-9bf86fc80476 tempest-ProjectReaderTests-154902682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:56 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:23:56 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:57 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f7412018-a58f-48c6-8729-9bf86fc80476 tempest-ProjectReaderTests-154902682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.259s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:57 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-f7412018-a58f-48c6-8729-9bf86fc80476 tempest-ProjectReaderTests-154902682 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:57 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-f7412018-a58f-48c6-8729-9bf86fc80476 tempest-ProjectReaderTests-154902682 None] Deleted volume successfully. Sep 09 18:23:57 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f7412018-a58f-48c6-8729-9bf86fc80476 tempest-ProjectReaderTests-154902682 None] Lock "cinder-fab9208a-6723-4181-a3ec-a2aaa72f81a6-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:57 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-56d77bc5-b910-4545-97fe-bab5e9a988e2 tempest-VolumesExtendTest-1907060485 None] Acquiring lock "cinder-1754b7be-47b0-40a6-9a90-888d70c94fb6-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:57 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-56d77bc5-b910-4545-97fe-bab5e9a988e2 tempest-VolumesExtendTest-1907060485 None] Lock "cinder-1754b7be-47b0-40a6-9a90-888d70c94fb6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:57 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-56d77bc5-b910-4545-97fe-bab5e9a988e2 tempest-VolumesExtendTest-1907060485 None] Acquiring lock "cinder-quobyte-1754b7be-47b0-40a6-9a90-888d70c94fb6" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:23:57 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-56d77bc5-b910-4545-97fe-bab5e9a988e2 tempest-VolumesExtendTest-1907060485 None] Lock "cinder-quobyte-1754b7be-47b0-40a6-9a90-888d70c94fb6" acquired by "delete_volume" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:23:57 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7bd6f9-e22f-4d1f-9da0-70af6c98b755]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:23:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-56d77bc5-b910-4545-97fe-bab5e9a988e2 tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:57 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6 Sep 09 18:23:57 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:58 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-56d77bc5-b910-4545-97fe-bab5e9a988e2 tempest-VolumesExtendTest-1907060485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6" returned: 0 in 0.784s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-56d77bc5-b910-4545-97fe-bab5e9a988e2 tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:58 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6 Sep 09 18:23:58 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:58 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-56d77bc5-b910-4545-97fe-bab5e9a988e2 tempest-VolumesExtendTest-1907060485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1754b7be-47b0-40a6-9a90-888d70c94fb6" returned: 0 in 0.572s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:58 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-56d77bc5-b910-4545-97fe-bab5e9a988e2 tempest-VolumesExtendTest-1907060485 None] Lock "cinder-quobyte-1754b7be-47b0-40a6-9a90-888d70c94fb6" released by "delete_volume" :: held 1.430s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:23:59 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-56d77bc5-b910-4545-97fe-bab5e9a988e2 tempest-VolumesExtendTest-1907060485 None] Created reservations ['5001f689-1e41-401a-b4cd-39f11fdeaf36', '9719de5f-03a4-452c-835e-a53cc62d8693', 'e558bf37-62ae-4284-a3e0-84ab23bf975d', 'd37b196b-9e5f-41df-b8ce-48552e06f971'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:23:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-56d77bc5-b910-4545-97fe-bab5e9a988e2 tempest-VolumesExtendTest-1907060485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:23:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-56d77bc5-b910-4545-97fe-bab5e9a988e2 tempest-VolumesExtendTest-1907060485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:23:59 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-56d77bc5-b910-4545-97fe-bab5e9a988e2 tempest-VolumesExtendTest-1907060485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:23:59 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-56d77bc5-b910-4545-97fe-bab5e9a988e2 tempest-VolumesExtendTest-1907060485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:23:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-56d77bc5-b910-4545-97fe-bab5e9a988e2 tempest-VolumesExtendTest-1907060485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:23:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-56d77bc5-b910-4545-97fe-bab5e9a988e2 tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:23:59 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:23:59 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:23:59 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Sep 09 18:23:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-56d77bc5-b910-4545-97fe-bab5e9a988e2 tempest-VolumesExtendTest-1907060485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.355s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:23:59 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-56d77bc5-b910-4545-97fe-bab5e9a988e2 tempest-VolumesExtendTest-1907060485 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:23:59 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-56d77bc5-b910-4545-97fe-bab5e9a988e2 tempest-VolumesExtendTest-1907060485 None] Deleted volume successfully. Sep 09 18:23:59 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-56d77bc5-b910-4545-97fe-bab5e9a988e2 tempest-VolumesExtendTest-1907060485 None] Lock "cinder-1754b7be-47b0-40a6-9a90-888d70c94fb6-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:24:00 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:24:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Flow 'volume_create_manager' (95d4aa68-ba30-4a38-a8cb-f98df910ce5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:24:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000b9eb8-f714-4aed-a53d-e676523c88ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:00 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:24:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Flow 'volume_create_manager' (84efe757-793e-4574-8d38-dbb54dfda263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:24:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d04d6a2-177a-4b0d-9968-e7581a5cb1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d04d6a2-177a-4b0d-9968-e7581a5cb1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-580660607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afbe654d-f320-4ffc-b470-de4534508278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48773ff7d70646e099a268f950af3f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:24:01Z,use_quota=True,user_id='6c7de289bdcd4df2a7563cf24c691308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c07e0bc-beb6-4a9d-a386-69cf9f6eccf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c07e0bc-beb6-4a9d-a386-69cf9f6eccf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4429913-4ff8-495a-865e-12d170d8e3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4429913-4ff8-495a-865e-12d170d8e3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afbe654d-f320-4ffc-b470-de4534508278', 'volume_name': 'volume-afbe654d-f320-4ffc-b470-de4534508278', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca46b9a3-89fe-4b59-a2e0-5f338509bda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca46b9a3-89fe-4b59-a2e0-5f338509bda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd372b0-a481-4063-b50b-c2758fbb4df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:01 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Volume afbe654d-f320-4ffc-b470-de4534508278: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afbe654d-f320-4ffc-b470-de4534508278', 'volume_size': 1} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-580660607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afbe654d-f320-4ffc-b470-de4534508278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48773ff7d70646e099a268f950af3f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:24:01Z,use_quota=True,user_id='6c7de289bdcd4df2a7563cf24c691308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Creating volume afbe654d-f320-4ffc-b470-de4534508278 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:24:01 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-afbe654d-f320-4ffc-b470-de4534508278 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (000b9eb8-f714-4aed-a53d-e676523c88ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-374032389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71171c9-ed96-4b25-b338-b126b06ee698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36592aa405548dfbbeb629cffeb154b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:24:01Z,use_quota=True,user_id='7e5a7529f57944f698ceb9121067a026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faac5a89-c03c-498a-81f4-f6621ea1b2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faac5a89-c03c-498a-81f4-f6621ea1b2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3c8e49-2b4a-4eb5-96ae-0b8456a21a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3c8e49-2b4a-4eb5-96ae-0b8456a21a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c71171c9-ed96-4b25-b338-b126b06ee698', 'volume_name': 'volume-c71171c9-ed96-4b25-b338-b126b06ee698', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (504c3bff-962e-4e1e-a94a-b4f4391717ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (504c3bff-962e-4e1e-a94a-b4f4391717ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd0f24e7-1dfe-4f5f-84b6-b913a60d91c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:01 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Volume c71171c9-ed96-4b25-b338-b126b06ee698: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c71171c9-ed96-4b25-b338-b126b06ee698', 'volume_size': 1} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:01 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-afbe654d-f320-4ffc-b470-de4534508278 1073741824 Sep 09 18:24:01 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:01 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-afbe654d-f320-4ffc-b470-de4534508278 1073741824" returned: 0 in 0.633s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-afbe654d-f320-4ffc-b470-de4534508278 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:01 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-afbe654d-f320-4ffc-b470-de4534508278 Sep 09 18:24:01 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:01 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-afbe654d-f320-4ffc-b470-de4534508278" returned: 0 in 0.255s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:24:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.864s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-374032389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71171c9-ed96-4b25-b338-b126b06ee698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b36592aa405548dfbbeb629cffeb154b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:24:01Z,use_quota=True,user_id='7e5a7529f57944f698ceb9121067a026',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:24:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Creating volume c71171c9-ed96-4b25-b338-b126b06ee698 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:24:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:24:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:24:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:24:02 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:24:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:02 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698 1073741824 Sep 09 18:24:02 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd372b0-a481-4063-b50b-c2758fbb4df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afbe654d-f320-4ffc-b470-de4534508278', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ada9d93-1aa8-44aa-a75d-9c1296c3530a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:02 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Volume volume-afbe654d-f320-4ffc-b470-de4534508278 (afbe654d-f320-4ffc-b470-de4534508278): created successfully Sep 09 18:24:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ada9d93-1aa8-44aa-a75d-9c1296c3530a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Flow 'volume_create_manager' (84efe757-793e-4574-8d38-dbb54dfda263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:24:02 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-3c1faf12-cc54-4ff7-9acd-f4375d992877 tempest-TestMinimumBasicScenario-389590853 None] Created volume successfully. Sep 09 18:24:02 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698 1073741824" returned: 0 in 0.528s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:02 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698 Sep 09 18:24:02 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:02 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698" returned: 0 in 0.342s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:24:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd0f24e7-1dfe-4f5f-84b6-b913a60d91c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c71171c9-ed96-4b25-b338-b126b06ee698', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57d940e-ca97-4b3e-8d5e-6eac1436a84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:02 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Volume volume-c71171c9-ed96-4b25-b338-b126b06ee698 (c71171c9-ed96-4b25-b338-b126b06ee698): created successfully Sep 09 18:24:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57d940e-ca97-4b3e-8d5e-6eac1436a84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Flow 'volume_create_manager' (95d4aa68-ba30-4a38-a8cb-f98df910ce5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:24:03 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-1e7ce50c-c3a2-446d-a859-46f449bb98ce tempest-VolumesExtendTest-1907060485 None] Created volume successfully. Sep 09 18:24:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-45a02dc7-2658-4b68-a4b8-b4a13e2a4cff req-344e95e3-920a-4883-a897-5162c4a1f58b tempest-TestMinimumBasicScenario-389590853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-45a02dc7-2658-4b68-a4b8-b4a13e2a4cff req-344e95e3-920a-4883-a897-5162c4a1f58b tempest-TestMinimumBasicScenario-389590853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-45a02dc7-2658-4b68-a4b8-b4a13e2a4cff req-344e95e3-920a-4883-a897-5162c4a1f58b tempest-TestMinimumBasicScenario-389590853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:04 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-45a02dc7-2658-4b68-a4b8-b4a13e2a4cff req-344e95e3-920a-4883-a897-5162c4a1f58b tempest-TestMinimumBasicScenario-389590853 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-afbe654d-f320-4ffc-b470-de4534508278', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '634d9900-c256-4a26-b9bb-fe55309193f8', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:24:04 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-45a02dc7-2658-4b68-a4b8-b4a13e2a4cff req-344e95e3-920a-4883-a897-5162c4a1f58b tempest-TestMinimumBasicScenario-389590853 None] attachment_update completed successfully. Sep 09 18:24:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-72d2530f-a63d-43f3-8a25-b03501645e3c tempest-VolumesExtendTest-1907060485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-72d2530f-a63d-43f3-8a25-b03501645e3c tempest-VolumesExtendTest-1907060485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:04 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-72d2530f-a63d-43f3-8a25-b03501645e3c tempest-VolumesExtendTest-1907060485 None] Creating offline snapshot f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8 of volume c71171c9-ed96-4b25-b338-b126b06ee698 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:24:04 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3127cb-1861-42c3-b412-d297334ddab6]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:24:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-72d2530f-a63d-43f3-8a25-b03501645e3c tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:04 devstack sudo[101530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698 Sep 09 18:24:04 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:04 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-72d2530f-a63d-43f3-8a25-b03501645e3c tempest-VolumesExtendTest-1907060485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698" returned: 0 in 0.590s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-72d2530f-a63d-43f3-8a25-b03501645e3c tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:04 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8 1G Sep 09 18:24:04 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:05 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-72d2530f-a63d-43f3-8a25-b03501645e3c tempest-VolumesExtendTest-1907060485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8 1G" returned: 0 in 0.614s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-72d2530f-a63d-43f3-8a25-b03501645e3c tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c71171c9-ed96-4b25-b338-b126b06ee698 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:05 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c71171c9-ed96-4b25-b338-b126b06ee698 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8 Sep 09 18:24:05 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:05 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-72d2530f-a63d-43f3-8a25-b03501645e3c tempest-VolumesExtendTest-1907060485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c71171c9-ed96-4b25-b338-b126b06ee698 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8" returned: 0 in 0.332s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:05 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-72d2530f-a63d-43f3-8a25-b03501645e3c tempest-VolumesExtendTest-1907060485 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8 is being set with open permissions: ugo+rw Sep 09 18:24:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-72d2530f-a63d-43f3-8a25-b03501645e3c tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:05 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8 Sep 09 18:24:05 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:06 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-72d2530f-a63d-43f3-8a25-b03501645e3c tempest-VolumesExtendTest-1907060485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8" returned: 0 in 0.471s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:06 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=156,cinder:UPDATE=217,cinder:INSERT=53,cinder:DELETE=11 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:24:06 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=172,cinder:INSERT=54,cinder:UPDATE=191,cinder:DELETE=21 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:24:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-72d2530f-a63d-43f3-8a25-b03501645e3c tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:06 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.info Sep 09 18:24:06 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:06 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-72d2530f-a63d-43f3-8a25-b03501645e3c tempest-VolumesExtendTest-1907060485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.info" returned: 0 in 0.434s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:06 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-72d2530f-a63d-43f3-8a25-b03501645e3c tempest-VolumesExtendTest-1907060485 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.info is being set with open permissions: ugo+rw Sep 09 18:24:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-72d2530f-a63d-43f3-8a25-b03501645e3c tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:06 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.info Sep 09 18:24:06 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:07 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-72d2530f-a63d-43f3-8a25-b03501645e3c tempest-VolumesExtendTest-1907060485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.info" returned: 0 in 0.364s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-72d2530f-a63d-43f3-8a25-b03501645e3c tempest-VolumesExtendTest-1907060485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.959s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:07 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-72d2530f-a63d-43f3-8a25-b03501645e3c tempest-VolumesExtendTest-1907060485 None] Create snapshot completed successfully Sep 09 18:24:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6ccc81c2-1601-40a7-a01e-2eefe34fbd55 tempest-VolumesExtendTest-1907060485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6ccc81c2-1601-40a7-a01e-2eefe34fbd55 tempest-VolumesExtendTest-1907060485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:07 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a51c47d-0c04-435f-81f7-c202091cc464]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:24:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6ccc81c2-1601-40a7-a01e-2eefe34fbd55 tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:07 devstack sudo[101943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698 Sep 09 18:24:07 devstack sudo[101943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:08 devstack sudo[101943]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6ccc81c2-1601-40a7-a01e-2eefe34fbd55 tempest-VolumesExtendTest-1907060485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698" returned: 0 in 0.518s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6ccc81c2-1601-40a7-a01e-2eefe34fbd55 tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8 2G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6ccc81c2-1601-40a7-a01e-2eefe34fbd55 tempest-VolumesExtendTest-1907060485 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8 2G" returned: 0 in 0.206s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6ccc81c2-1601-40a7-a01e-2eefe34fbd55 tempest-VolumesExtendTest-1907060485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.778s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:08 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-6ccc81c2-1601-40a7-a01e-2eefe34fbd55 tempest-VolumesExtendTest-1907060485 None] Extend volume completed successfully. Sep 09 18:24:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ac0469ee-3d91-4499-8c4a-b51b7732444c tempest-VolumesExtendTest-1907060485 None] Acquiring lock "cinder-f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:24:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ac0469ee-3d91-4499-8c4a-b51b7732444c tempest-VolumesExtendTest-1907060485 None] Lock "cinder-f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:24:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ac0469ee-3d91-4499-8c4a-b51b7732444c tempest-VolumesExtendTest-1907060485 None] Acquiring lock "cinder-quobyte-c71171c9-ed96-4b25-b338-b126b06ee698" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:24:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ac0469ee-3d91-4499-8c4a-b51b7732444c tempest-VolumesExtendTest-1907060485 None] Lock "cinder-quobyte-c71171c9-ed96-4b25-b338-b126b06ee698" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:24:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ac0469ee-3d91-4499-8c4a-b51b7732444c tempest-VolumesExtendTest-1907060485 None] Acquiring lock "cinder-quobyte-f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:24:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ac0469ee-3d91-4499-8c4a-b51b7732444c tempest-VolumesExtendTest-1907060485 None] Lock "cinder-quobyte-f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:24:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-ac0469ee-3d91-4499-8c4a-b51b7732444c tempest-VolumesExtendTest-1907060485 None] Deleting offline snapshot f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8 of volume c71171c9-ed96-4b25-b338-b126b06ee698 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:24:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-ac0469ee-3d91-4499-8c4a-b51b7732444c tempest-VolumesExtendTest-1907060485 None] snapshot_file for this snap is: volume-c71171c9-ed96-4b25-b338-b126b06ee698.f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:24:09 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d346c7-45d9-4de9-b423-3717f030eecf]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:24:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ac0469ee-3d91-4499-8c4a-b51b7732444c tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:09 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8 Sep 09 18:24:09 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:09 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ac0469ee-3d91-4499-8c4a-b51b7732444c tempest-VolumesExtendTest-1907060485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8" returned: 0 in 0.622s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-ac0469ee-3d91-4499-8c4a-b51b7732444c tempest-VolumesExtendTest-1907060485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c71171c9-ed96-4b25-b338-b126b06ee698(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:24:09 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07fd45c-a34d-494d-a9ad-ddc0189788f3]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:24:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ac0469ee-3d91-4499-8c4a-b51b7732444c tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:09 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698 Sep 09 18:24:09 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:10 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ac0469ee-3d91-4499-8c4a-b51b7732444c tempest-VolumesExtendTest-1907060485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698" returned: 0 in 0.484s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ac0469ee-3d91-4499-8c4a-b51b7732444c tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:10 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8 Sep 09 18:24:10 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:10 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ac0469ee-3d91-4499-8c4a-b51b7732444c tempest-VolumesExtendTest-1907060485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8" returned: 0 in 0.452s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ac0469ee-3d91-4499-8c4a-b51b7732444c tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:10 devstack sudo[101998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8 Sep 09 18:24:10 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:11 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ac0469ee-3d91-4499-8c4a-b51b7732444c tempest-VolumesExtendTest-1907060485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698.f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8" returned: 0 in 0.281s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:11 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ac0469ee-3d91-4499-8c4a-b51b7732444c tempest-VolumesExtendTest-1907060485 None] Lock "cinder-quobyte-f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8" released by "_delete_snapshot" :: held 1.993s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:24:11 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ac0469ee-3d91-4499-8c4a-b51b7732444c tempest-VolumesExtendTest-1907060485 None] Lock "cinder-quobyte-c71171c9-ed96-4b25-b338-b126b06ee698" released by "delete_snapshot" :: held 2.033s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:24:11 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-ac0469ee-3d91-4499-8c4a-b51b7732444c tempest-VolumesExtendTest-1907060485 None] Created reservations ['e5fd3f38-47f1-4f43-b4ec-9b6103d6f665', 'a51fb0eb-6b05-437b-a95e-e756efb8f955', 'fc046d4e-ab91-4b18-a32d-0569668fd7d5', '2cbf2c24-b963-4556-94fa-9518a9bed787'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:24:11 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ac0469ee-3d91-4499-8c4a-b51b7732444c tempest-VolumesExtendTest-1907060485 None] Delete snapshot completed successfully. Sep 09 18:24:11 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ac0469ee-3d91-4499-8c4a-b51b7732444c tempest-VolumesExtendTest-1907060485 None] Lock "cinder-f1b53ba3-78f3-4da1-8d14-36a1f9c5b4f8-delete_snapshot" released by "delete_snapshot" :: held 2.214s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:24:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e59513c4-eb2c-4eb0-a845-5534c144cd16 tempest-VolumesExtendTest-1907060485 None] Acquiring lock "cinder-c71171c9-ed96-4b25-b338-b126b06ee698-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:24:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e59513c4-eb2c-4eb0-a845-5534c144cd16 tempest-VolumesExtendTest-1907060485 None] Lock "cinder-c71171c9-ed96-4b25-b338-b126b06ee698-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:24:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e59513c4-eb2c-4eb0-a845-5534c144cd16 tempest-VolumesExtendTest-1907060485 None] Acquiring lock "cinder-quobyte-c71171c9-ed96-4b25-b338-b126b06ee698" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:24:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e59513c4-eb2c-4eb0-a845-5534c144cd16 tempest-VolumesExtendTest-1907060485 None] Lock "cinder-quobyte-c71171c9-ed96-4b25-b338-b126b06ee698" acquired by "delete_volume" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:24:12 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2ee461-a3bb-42c6-b486-e8f719ebdc0b]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:24:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e59513c4-eb2c-4eb0-a845-5534c144cd16 tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:12 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698 Sep 09 18:24:12 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:12 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e59513c4-eb2c-4eb0-a845-5534c144cd16 tempest-VolumesExtendTest-1907060485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698" returned: 0 in 0.411s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e59513c4-eb2c-4eb0-a845-5534c144cd16 tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:12 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698 Sep 09 18:24:12 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:13 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e59513c4-eb2c-4eb0-a845-5534c144cd16 tempest-VolumesExtendTest-1907060485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c71171c9-ed96-4b25-b338-b126b06ee698" returned: 0 in 0.273s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:13 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e59513c4-eb2c-4eb0-a845-5534c144cd16 tempest-VolumesExtendTest-1907060485 None] Lock "cinder-quobyte-c71171c9-ed96-4b25-b338-b126b06ee698" released by "delete_volume" :: held 0.775s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:24:13 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-e59513c4-eb2c-4eb0-a845-5534c144cd16 tempest-VolumesExtendTest-1907060485 None] Created reservations ['c2391927-ce6d-4030-b841-d83f54be1e7b', '5e873c45-3811-457e-837e-9363d424f2bf', 'bc0bae64-9acb-4d7f-ad33-cadfa54820aa', 'fd6a2a69-b4df-45eb-96b6-aca278d14391'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:24:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e59513c4-eb2c-4eb0-a845-5534c144cd16 tempest-VolumesExtendTest-1907060485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e59513c4-eb2c-4eb0-a845-5534c144cd16 tempest-VolumesExtendTest-1907060485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e59513c4-eb2c-4eb0-a845-5534c144cd16 tempest-VolumesExtendTest-1907060485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:24:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e59513c4-eb2c-4eb0-a845-5534c144cd16 tempest-VolumesExtendTest-1907060485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:24:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e59513c4-eb2c-4eb0-a845-5534c144cd16 tempest-VolumesExtendTest-1907060485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e59513c4-eb2c-4eb0-a845-5534c144cd16 tempest-VolumesExtendTest-1907060485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:13 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:24:13 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:13 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e59513c4-eb2c-4eb0-a845-5534c144cd16 tempest-VolumesExtendTest-1907060485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.461s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:13 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-e59513c4-eb2c-4eb0-a845-5534c144cd16 tempest-VolumesExtendTest-1907060485 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:24:13 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-e59513c4-eb2c-4eb0-a845-5534c144cd16 tempest-VolumesExtendTest-1907060485 None] Deleted volume successfully. Sep 09 18:24:13 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e59513c4-eb2c-4eb0-a845-5534c144cd16 tempest-VolumesExtendTest-1907060485 None] Lock "cinder-c71171c9-ed96-4b25-b338-b126b06ee698-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:24:20 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:24:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Flow 'volume_create_manager' (4febad10-f4ba-421d-a39e-d6b975d0a011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:24:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ab96bb-9add-47da-9633-b9a321b96991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26ab96bb-9add-47da-9633-b9a321b96991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b047fdfa5134dcc8526319bb12be8b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:24:21Z,use_quota=True,user_id='141439066f2f42b0abafc94269b6b0cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03fa02b0-7536-4f83-b467-f1346f87dbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03fa02b0-7536-4f83-b467-f1346f87dbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c8dbea-f730-4f04-98f0-589ce36f3997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:20 devstack cinder-volume[87639]: DEBUG cinder.image.glance [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Creating Keystone auth plugin from conf {{(pid=87639) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 18:24:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4c8dbea-f730-4f04-98f0-589ce36f3997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4', 'volume_name': 'volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4', 'volume_size': 1, 'image_id': '94df1ed0-5dee-4c04-afaa-4b77ff0c072a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94df1ed0-5dee-4c04-afaa-4b77ff0c072a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1aeab5aa13dfbf338007439912691f09', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3b047fdfa5134dcc8526319bb12be8b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'abc4dd58c5c43eb0af40a9167c9e9d134c2e4de8b32e2da21b44e297f438efd6d505f601431b9c7635c0e2b4a5b9e1e736eeee4f59acc56916e23676806fb6e7', 'id': '94df1ed0-5dee-4c04-afaa-4b77ff0c072a', 'created_at': datetime.datetime(2026, 9, 9, 16, 24, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 24, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94df1ed0-5dee-4c04-afaa-4b77ff0c072a/file', 'properties': {}}, 'image_service': }' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b196e459-3d50-4c7c-8b00-a58898176677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b196e459-3d50-4c7c-8b00-a58898176677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4bbe0fb-0d4a-45b2-9fc7-cf0b9edb91ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:21 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Volume a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4', 'volume_size': 1, 'image_id': '94df1ed0-5dee-4c04-afaa-4b77ff0c072a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94df1ed0-5dee-4c04-afaa-4b77ff0c072a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1aeab5aa13dfbf338007439912691f09', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3b047fdfa5134dcc8526319bb12be8b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'abc4dd58c5c43eb0af40a9167c9e9d134c2e4de8b32e2da21b44e297f438efd6d505f601431b9c7635c0e2b4a5b9e1e736eeee4f59acc56916e23676806fb6e7', 'id': '94df1ed0-5dee-4c04-afaa-4b77ff0c072a', 'created_at': datetime.datetime(2026, 9, 9, 16, 24, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 24, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94df1ed0-5dee-4c04-afaa-4b77ff0c072a/file', 'properties': {}}, 'image_service': } Sep 09 18:24:21 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Trying to clone a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4 from image 94df1ed0-5dee-4c04-afaa-4b77ff0c072a at location (None, [{'url': 'file:///opt/stack/data/glance/images/94df1ed0-5dee-4c04-afaa-4b77ff0c072a', 'metadata': {}}]). {{(pid=87639) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 18:24:21 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 18:24:21 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Image download 0.00 MB at 0.00 MB/s Sep 09 18:24:21 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfe2d76-90a0-4d4e-a7e3-3cf2cbe9009f]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:24:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:21 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD Sep 09 18:24:21 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:21 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD" returned: 0 in 0.449s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:21 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD Sep 09 18:24:21 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:22 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD" returned: 1 in 0.544s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:24:22 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Temporary image 94df1ed0-5dee-4c04-afaa-4b77ff0c072a is fetched for user 141439066f2f42b0abafc94269b6b0cb. {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 18:24:22 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2bc567-6007-45cc-b1d2-7f14e08cf704]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:24:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:22 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD Sep 09 18:24:22 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:22 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:22 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD Sep 09 18:24:22 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:23 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:24:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b047fdfa5134dcc8526319bb12be8b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:24:21Z,use_quota=True,user_id='141439066f2f42b0abafc94269b6b0cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:24:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Creating volume a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:24:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:24:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:24:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:24:23 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:24:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:23 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4 1073741824 Sep 09 18:24:23 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:23 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4 1073741824" returned: 0 in 0.544s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:23 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4 Sep 09 18:24:23 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:23 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4" returned: 0 in 0.259s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:24:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:23 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Attempting download of 94df1ed0-5dee-4c04-afaa-4b77ff0c072a ((None, [{'url': 'file:///opt/stack/data/glance/images/94df1ed0-5dee-4c04-afaa-4b77ff0c072a', 'metadata': {}}])) to volume a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4. {{(pid=87639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 18:24:24 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c138c24c-ab54-487c-9dd3-c92aa1eea764]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:24:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_33q9q3wr {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:24 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_33q9q3wr Sep 09 18:24:24 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:24 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_33q9q3wr" returned: 0 in 0.373s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_33q9q3wr {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:24 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_33q9q3wr Sep 09 18:24:24 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:24 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_33q9q3wr" returned: 1 in 0.380s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_33q9q3wr' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:24:24 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[db300e83-dc4c-4ba6-8f59-1b9fabff7246]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:24:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:24 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD Sep 09 18:24:24 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:25 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:25 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD Sep 09 18:24:25 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:25 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:24:25 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] 94df1ed0-5dee-4c04-afaa-4b77ff0c072a was raw, converting to qcow2 {{(pid=87639) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 18:24:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:25 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4 Sep 09 18:24:25 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:26 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4" returned: 0 in 0.553s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:26 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_94df1ed0-5dee-4c04-afaa-4b77ff0c072a_nihe7g4cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4 {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:24:26 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Converted 0.00 MB image at 0.00 MB/s Sep 09 18:24:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:26 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4 1G Sep 09 18:24:26 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:26 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4 1G" returned: 0 in 0.417s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:26 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Downloaded image 94df1ed0-5dee-4c04-afaa-4b77ff0c072a ((None, [{'url': 'file:///opt/stack/data/glance/images/94df1ed0-5dee-4c04-afaa-4b77ff0c072a', 'metadata': {}}])) to volume a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4 successfully. {{(pid=87639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 18:24:26 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Temporary image 94df1ed0-5dee-4c04-afaa-4b77ff0c072a for user 141439066f2f42b0abafc94269b6b0cb is deleted. {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 18:24:26 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Marking volume a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4 as bootable. {{(pid=87639) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 18:24:26 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Copying metadata from image 94df1ed0-5dee-4c04-afaa-4b77ff0c072a to a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4. {{(pid=87639) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 18:24:26 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Creating volume glance metadata for volume a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4 backed by image 94df1ed0-5dee-4c04-afaa-4b77ff0c072a with: {'image_id': '94df1ed0-5dee-4c04-afaa-4b77ff0c072a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1aeab5aa13dfbf338007439912691f09', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87639) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 18:24:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4bbe0fb-0d4a-45b2-9fc7-cf0b9edb91ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4', 'volume_size': 1, 'image_id': '94df1ed0-5dee-4c04-afaa-4b77ff0c072a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94df1ed0-5dee-4c04-afaa-4b77ff0c072a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1aeab5aa13dfbf338007439912691f09', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3b047fdfa5134dcc8526319bb12be8b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'abc4dd58c5c43eb0af40a9167c9e9d134c2e4de8b32e2da21b44e297f438efd6d505f601431b9c7635c0e2b4a5b9e1e736eeee4f59acc56916e23676806fb6e7', 'id': '94df1ed0-5dee-4c04-afaa-4b77ff0c072a', 'created_at': datetime.datetime(2026, 9, 9, 16, 24, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 24, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94df1ed0-5dee-4c04-afaa-4b77ff0c072a/file', 'properties': {}}, 'image_service': }' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d7fbe6-3a2c-4246-97a6-fb17c241b82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:26 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Volume volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4 (a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4): created successfully Sep 09 18:24:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d7fbe6-3a2c-4246-97a6-fb17c241b82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Flow 'volume_create_manager' (4febad10-f4ba-421d-a39e-d6b975d0a011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:24:26 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-21850d7c-49c4-48ec-81d2-850464c7e766 tempest-VolumeImageDependencyTests-389240726 None] Created volume successfully. Sep 09 18:24:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-30da1bb5-2a5d-4ecb-a59b-c6092c4f80a4 tempest-VolumeImageDependencyTests-389240726 None] Acquiring lock "cinder-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:24:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-30da1bb5-2a5d-4ecb-a59b-c6092c4f80a4 tempest-VolumeImageDependencyTests-389240726 None] Lock "cinder-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:24:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-30da1bb5-2a5d-4ecb-a59b-c6092c4f80a4 tempest-VolumeImageDependencyTests-389240726 None] Acquiring lock "cinder-quobyte-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:24:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-30da1bb5-2a5d-4ecb-a59b-c6092c4f80a4 tempest-VolumeImageDependencyTests-389240726 None] Lock "cinder-quobyte-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4" acquired by "delete_volume" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:24:27 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[774a9acd-8277-4a08-a849-3f18d7f77a94]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:24:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-30da1bb5-2a5d-4ecb-a59b-c6092c4f80a4 tempest-VolumeImageDependencyTests-389240726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:27 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4 Sep 09 18:24:27 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:27 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-30da1bb5-2a5d-4ecb-a59b-c6092c4f80a4 tempest-VolumeImageDependencyTests-389240726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4" returned: 0 in 0.456s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-30da1bb5-2a5d-4ecb-a59b-c6092c4f80a4 tempest-VolumeImageDependencyTests-389240726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:27 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4 Sep 09 18:24:27 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:28 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-30da1bb5-2a5d-4ecb-a59b-c6092c4f80a4 tempest-VolumeImageDependencyTests-389240726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4" returned: 0 in 0.379s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:28 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-30da1bb5-2a5d-4ecb-a59b-c6092c4f80a4 tempest-VolumeImageDependencyTests-389240726 None] Lock "cinder-quobyte-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4" released by "delete_volume" :: held 0.884s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:24:28 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-30da1bb5-2a5d-4ecb-a59b-c6092c4f80a4 tempest-VolumeImageDependencyTests-389240726 None] Created reservations ['89372447-cf3a-4f85-918c-4ed761f873dc', '6350b935-17ea-49c9-87e8-a78f8b20b2be', '7ccc51a3-92b2-4ee7-852a-23174fe6ceac', '9d6ae214-ca8b-40b1-bbba-6e777ac0b3de'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:24:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-30da1bb5-2a5d-4ecb-a59b-c6092c4f80a4 tempest-VolumeImageDependencyTests-389240726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-30da1bb5-2a5d-4ecb-a59b-c6092c4f80a4 tempest-VolumeImageDependencyTests-389240726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-30da1bb5-2a5d-4ecb-a59b-c6092c4f80a4 tempest-VolumeImageDependencyTests-389240726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:24:28 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-30da1bb5-2a5d-4ecb-a59b-c6092c4f80a4 tempest-VolumeImageDependencyTests-389240726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:24:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-30da1bb5-2a5d-4ecb-a59b-c6092c4f80a4 tempest-VolumeImageDependencyTests-389240726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-30da1bb5-2a5d-4ecb-a59b-c6092c4f80a4 tempest-VolumeImageDependencyTests-389240726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:28 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:24:28 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:28 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-30da1bb5-2a5d-4ecb-a59b-c6092c4f80a4 tempest-VolumeImageDependencyTests-389240726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.544s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:28 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-30da1bb5-2a5d-4ecb-a59b-c6092c4f80a4 tempest-VolumeImageDependencyTests-389240726 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:24:28 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-30da1bb5-2a5d-4ecb-a59b-c6092c4f80a4 tempest-VolumeImageDependencyTests-389240726 None] Deleted volume successfully. Sep 09 18:24:28 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-30da1bb5-2a5d-4ecb-a59b-c6092c4f80a4 tempest-VolumeImageDependencyTests-389240726 None] Lock "cinder-a437d4bf-b0ef-4b0e-a4a3-42b27fd462b4-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Flow 'volume_create_manager' (fd16cca8-02b5-4213-94b5-7f2b67a3ac97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5880959b-241a-4037-a2c7-8255853e663e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Flow 'volume_create_manager' (f3d14017-a432-4258-8679-f0350f1343b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd792392-2ef6-4e37-914e-4ee8055ff2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5880959b-241a-4037-a2c7-8255853e663e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c9cde5-29f7-423c-9a7c-a52cd70d7ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a71db7c5ff1452f8b894261785f4ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:24:34Z,use_quota=True,user_id='9867e6e4b8fd4d018383f9060b40fbc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135913ed-77a7-454a-85dd-9562179f0b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135913ed-77a7-454a-85dd-9562179f0b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d8f00d-3377-484b-8770-2ab7513eefc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d8f00d-3377-484b-8770-2ab7513eefc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20c9cde5-29f7-423c-9a7c-a52cd70d7ff0', 'volume_name': 'volume-20c9cde5-29f7-423c-9a7c-a52cd70d7ff0', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c773f0-e62b-4fec-8c72-a62e23c4705f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c773f0-e62b-4fec-8c72-a62e23c4705f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14499827-0fef-4a31-b753-a289a8a6178f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:34 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Volume 20c9cde5-29f7-423c-9a7c-a52cd70d7ff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20c9cde5-29f7-423c-9a7c-a52cd70d7ff0', 'volume_size': 1} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c9cde5-29f7-423c-9a7c-a52cd70d7ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a71db7c5ff1452f8b894261785f4ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:24:34Z,use_quota=True,user_id='9867e6e4b8fd4d018383f9060b40fbc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Creating volume 20c9cde5-29f7-423c-9a7c-a52cd70d7ff0 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:24:34 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-20c9cde5-29f7-423c-9a7c-a52cd70d7ff0 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:34 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-20c9cde5-29f7-423c-9a7c-a52cd70d7ff0 1073741824 Sep 09 18:24:34 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd792392-2ef6-4e37-914e-4ee8055ff2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-959067103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db29b72b-de23-44a3-b5a0-ba907a66a668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7acadd4dd6254dcabd2735253afaf5a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:24:34Z,use_quota=True,user_id='3364f20814904ee8a1cb3831e628614e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d08a1df-25ee-49d9-9e99-a40a374677c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d08a1df-25ee-49d9-9e99-a40a374677c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df162c0-ffce-4b21-bd9a-361d376bd414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df162c0-ffce-4b21-bd9a-361d376bd414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db29b72b-de23-44a3-b5a0-ba907a66a668', 'volume_name': 'volume-db29b72b-de23-44a3-b5a0-ba907a66a668', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9029fe-071f-4be2-8d3c-58d0b3c8dba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9029fe-071f-4be2-8d3c-58d0b3c8dba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff0e487-19b4-43c0-9fce-12986833e621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:34 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Volume db29b72b-de23-44a3-b5a0-ba907a66a668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db29b72b-de23-44a3-b5a0-ba907a66a668', 'volume_size': 1} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Flow 'volume_create_manager' (d0741e39-91d5-4b82-8d5a-bb47ae61c271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dccf6bb4-7ab3-49c6-8fa9-ad01f54909b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dccf6bb4-7ab3-49c6-8fa9-ad01f54909b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-47278133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f3a6ff-5d72-4483-8808-272b82e68d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7acadd4dd6254dcabd2735253afaf5a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:24:34Z,use_quota=True,user_id='3364f20814904ee8a1cb3831e628614e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c54aa64-3cc5-4538-8ff9-aed0a846f9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c54aa64-3cc5-4538-8ff9-aed0a846f9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b12c640-17ca-4001-9e4d-88970753380c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b12c640-17ca-4001-9e4d-88970753380c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03f3a6ff-5d72-4483-8808-272b82e68d7a', 'volume_name': 'volume-03f3a6ff-5d72-4483-8808-272b82e68d7a', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6632e3c8-b0f5-4feb-85bd-84116a04a6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6632e3c8-b0f5-4feb-85bd-84116a04a6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8580a060-5e3e-43d6-97cb-a9527f333948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:34 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Volume 03f3a6ff-5d72-4483-8808-272b82e68d7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03f3a6ff-5d72-4483-8808-272b82e68d7a', 'volume_size': 1} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:34 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-20c9cde5-29f7-423c-9a7c-a52cd70d7ff0 1073741824" returned: 0 in 0.629s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-20c9cde5-29f7-423c-9a7c-a52cd70d7ff0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:34 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-20c9cde5-29f7-423c-9a7c-a52cd70d7ff0 Sep 09 18:24:34 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:35 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-20c9cde5-29f7-423c-9a7c-a52cd70d7ff0" returned: 0 in 0.300s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:24:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.791s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-959067103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db29b72b-de23-44a3-b5a0-ba907a66a668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7acadd4dd6254dcabd2735253afaf5a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:24:34Z,use_quota=True,user_id='3364f20814904ee8a1cb3831e628614e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:24:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Creating volume db29b72b-de23-44a3-b5a0-ba907a66a668 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:24:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:24:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:24:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:24:35 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:24:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-db29b72b-de23-44a3-b5a0-ba907a66a668 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14499827-0fef-4a31-b753-a289a8a6178f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20c9cde5-29f7-423c-9a7c-a52cd70d7ff0', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbad0228-128f-4277-aa47-049e30bfc92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:35 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-db29b72b-de23-44a3-b5a0-ba907a66a668 1073741824 Sep 09 18:24:35 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:35 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Volume volume-20c9cde5-29f7-423c-9a7c-a52cd70d7ff0 (20c9cde5-29f7-423c-9a7c-a52cd70d7ff0): created successfully Sep 09 18:24:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbad0228-128f-4277-aa47-049e30bfc92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Flow 'volume_create_manager' (fd16cca8-02b5-4213-94b5-7f2b67a3ac97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:24:35 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-485f1d5f-1eda-45a5-a324-5fb3614fd2c2 tempest-CinderUnicodeTest-1323509825 None] Created volume successfully. Sep 09 18:24:35 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-db29b72b-de23-44a3-b5a0-ba907a66a668 1073741824" returned: 0 in 0.493s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-db29b72b-de23-44a3-b5a0-ba907a66a668 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:35 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-db29b72b-de23-44a3-b5a0-ba907a66a668 Sep 09 18:24:35 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:36 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-db29b72b-de23-44a3-b5a0-ba907a66a668" returned: 0 in 0.326s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.486s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:24:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-47278133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f3a6ff-5d72-4483-8808-272b82e68d7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7acadd4dd6254dcabd2735253afaf5a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:24:34Z,use_quota=True,user_id='3364f20814904ee8a1cb3831e628614e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Creating volume 03f3a6ff-5d72-4483-8808-272b82e68d7a {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:24:36 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03f3a6ff-5d72-4483-8808-272b82e68d7a 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff0e487-19b4-43c0-9fce-12986833e621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db29b72b-de23-44a3-b5a0-ba907a66a668', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1399776a-cb21-4fdb-8606-9acbf89259ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:36 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03f3a6ff-5d72-4483-8808-272b82e68d7a 1073741824 Sep 09 18:24:36 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:36 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Volume volume-db29b72b-de23-44a3-b5a0-ba907a66a668 (db29b72b-de23-44a3-b5a0-ba907a66a668): created successfully Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1399776a-cb21-4fdb-8606-9acbf89259ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Flow 'volume_create_manager' (f3d14017-a432-4258-8679-f0350f1343b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:24:36 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-90d8af4a-c5c8-434e-a2dd-5cb421444237 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Created volume successfully. Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Flow 'volume_create_manager' (7da7f08a-0ac3-4cc6-8e9f-e01128a4a024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa03a8c8-1baf-4bcb-9a80-c942f4c0c8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa03a8c8-1baf-4bcb-9a80-c942f4c0c8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:24:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-740608527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e1243ed-3305-4a7a-a74a-6ae158c0fc97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a71db7c5ff1452f8b894261785f4ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:24:37Z,use_quota=True,user_id='9867e6e4b8fd4d018383f9060b40fbc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79c66dc-659a-45a7-a748-494b05db82d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a79c66dc-659a-45a7-a748-494b05db82d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3559ed2-dfe2-466e-8044-004e7728af28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:36 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3559ed2-dfe2-466e-8044-004e7728af28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e1243ed-3305-4a7a-a74a-6ae158c0fc97', 'volume_name': 'volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657bef61-b5f6-420f-bdb5-f0ed3d13b682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657bef61-b5f6-420f-bdb5-f0ed3d13b682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff0f970-8547-440b-91d5-901ce784507b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:36 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Volume 1e1243ed-3305-4a7a-a74a-6ae158c0fc97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97', 'volume_size': 1} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03f3a6ff-5d72-4483-8808-272b82e68d7a 1073741824" returned: 0 in 0.665s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03f3a6ff-5d72-4483-8808-272b82e68d7a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:36 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03f3a6ff-5d72-4483-8808-272b82e68d7a Sep 09 18:24:36 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:37 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03f3a6ff-5d72-4483-8808-272b82e68d7a" returned: 0 in 0.267s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.313s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:24:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-740608527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e1243ed-3305-4a7a-a74a-6ae158c0fc97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a71db7c5ff1452f8b894261785f4ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:24:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:24:37Z,use_quota=True,user_id='9867e6e4b8fd4d018383f9060b40fbc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Creating volume 1e1243ed-3305-4a7a-a74a-6ae158c0fc97 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:24:37 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8580a060-5e3e-43d6-97cb-a9527f333948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03f3a6ff-5d72-4483-8808-272b82e68d7a', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f544ac36-9d3b-40c3-b93a-9a4b0d4c67fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:37 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97 1073741824 Sep 09 18:24:37 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:37 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Volume volume-03f3a6ff-5d72-4483-8808-272b82e68d7a (03f3a6ff-5d72-4483-8808-272b82e68d7a): created successfully Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f544ac36-9d3b-40c3-b93a-9a4b0d4c67fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Flow 'volume_create_manager' (d0741e39-91d5-4b82-8d5a-bb47ae61c271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:24:37 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-73724b78-8a43-4ef7-9729-fbb174ce3805 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Created volume successfully. Sep 09 18:24:37 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97 1073741824" returned: 0 in 0.511s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:37 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97 Sep 09 18:24:37 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:37 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97" returned: 0 in 0.311s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff0f970-8547-440b-91d5-901ce784507b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37992dc-ead0-4072-a7b7-4846809d790d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:24:38 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Volume volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97 (1e1243ed-3305-4a7a-a74a-6ae158c0fc97): created successfully Sep 09 18:24:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37992dc-ead0-4072-a7b7-4846809d790d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:24:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Flow 'volume_create_manager' (7da7f08a-0ac3-4cc6-8e9f-e01128a4a024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:24:38 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-0c8d27f5-85ad-4570-99ce-a3424c0e3f62 tempest-CinderUnicodeTest-1323509825 None] Created volume successfully. Sep 09 18:24:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-95cddcf0-987e-42a1-af14-dc64c9a850cb tempest-CinderUnicodeTest-1323509825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-95cddcf0-987e-42a1-af14-dc64c9a850cb tempest-CinderUnicodeTest-1323509825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-95cddcf0-987e-42a1-af14-dc64c9a850cb tempest-CinderUnicodeTest-1323509825 None] Creating offline snapshot 4cd9bf36-7f91-4f0c-9816-6697b895e632 of volume 1e1243ed-3305-4a7a-a74a-6ae158c0fc97 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:24:39 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e4e0c4-94a8-40cf-ba0a-5889ceaddbd8]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:24:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-95cddcf0-987e-42a1-af14-dc64c9a850cb tempest-CinderUnicodeTest-1323509825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:39 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97 Sep 09 18:24:39 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:39 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-95cddcf0-987e-42a1-af14-dc64c9a850cb tempest-CinderUnicodeTest-1323509825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97" returned: 0 in 0.539s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-95cddcf0-987e-42a1-af14-dc64c9a850cb tempest-CinderUnicodeTest-1323509825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.4cd9bf36-7f91-4f0c-9816-6697b895e632 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:39 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.4cd9bf36-7f91-4f0c-9816-6697b895e632 1G Sep 09 18:24:39 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:40 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-95cddcf0-987e-42a1-af14-dc64c9a850cb tempest-CinderUnicodeTest-1323509825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.4cd9bf36-7f91-4f0c-9816-6697b895e632 1G" returned: 0 in 0.519s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-95cddcf0-987e-42a1-af14-dc64c9a850cb tempest-CinderUnicodeTest-1323509825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.4cd9bf36-7f91-4f0c-9816-6697b895e632 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:40 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.4cd9bf36-7f91-4f0c-9816-6697b895e632 Sep 09 18:24:40 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:40 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-95cddcf0-987e-42a1-af14-dc64c9a850cb tempest-CinderUnicodeTest-1323509825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.4cd9bf36-7f91-4f0c-9816-6697b895e632" returned: 0 in 0.310s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:40 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-95cddcf0-987e-42a1-af14-dc64c9a850cb tempest-CinderUnicodeTest-1323509825 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.4cd9bf36-7f91-4f0c-9816-6697b895e632 is being set with open permissions: ugo+rw Sep 09 18:24:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-95cddcf0-987e-42a1-af14-dc64c9a850cb tempest-CinderUnicodeTest-1323509825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.4cd9bf36-7f91-4f0c-9816-6697b895e632 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:40 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.4cd9bf36-7f91-4f0c-9816-6697b895e632 Sep 09 18:24:40 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:40 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-95cddcf0-987e-42a1-af14-dc64c9a850cb tempest-CinderUnicodeTest-1323509825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.4cd9bf36-7f91-4f0c-9816-6697b895e632" returned: 0 in 0.253s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-95cddcf0-987e-42a1-af14-dc64c9a850cb tempest-CinderUnicodeTest-1323509825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:40 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.info Sep 09 18:24:40 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:41 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-95cddcf0-987e-42a1-af14-dc64c9a850cb tempest-CinderUnicodeTest-1323509825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.info" returned: 0 in 0.264s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:41 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-95cddcf0-987e-42a1-af14-dc64c9a850cb tempest-CinderUnicodeTest-1323509825 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.info is being set with open permissions: ugo+rw Sep 09 18:24:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-95cddcf0-987e-42a1-af14-dc64c9a850cb tempest-CinderUnicodeTest-1323509825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:41 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.info Sep 09 18:24:41 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:41 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-95cddcf0-987e-42a1-af14-dc64c9a850cb tempest-CinderUnicodeTest-1323509825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.info" returned: 0 in 0.288s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-95cddcf0-987e-42a1-af14-dc64c9a850cb tempest-CinderUnicodeTest-1323509825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.296s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:41 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-95cddcf0-987e-42a1-af14-dc64c9a850cb tempest-CinderUnicodeTest-1323509825 None] Create snapshot completed successfully Sep 09 18:24:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0a8e1c64-0923-4580-bccc-cd4cc53d9829 tempest-CinderUnicodeTest-1323509825 None] Acquiring lock "cinder-4cd9bf36-7f91-4f0c-9816-6697b895e632-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:24:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0a8e1c64-0923-4580-bccc-cd4cc53d9829 tempest-CinderUnicodeTest-1323509825 None] Lock "cinder-4cd9bf36-7f91-4f0c-9816-6697b895e632-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:24:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0a8e1c64-0923-4580-bccc-cd4cc53d9829 tempest-CinderUnicodeTest-1323509825 None] Acquiring lock "cinder-quobyte-1e1243ed-3305-4a7a-a74a-6ae158c0fc97" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:24:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0a8e1c64-0923-4580-bccc-cd4cc53d9829 tempest-CinderUnicodeTest-1323509825 None] Lock "cinder-quobyte-1e1243ed-3305-4a7a-a74a-6ae158c0fc97" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:24:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0a8e1c64-0923-4580-bccc-cd4cc53d9829 tempest-CinderUnicodeTest-1323509825 None] Acquiring lock "cinder-quobyte-4cd9bf36-7f91-4f0c-9816-6697b895e632" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:24:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0a8e1c64-0923-4580-bccc-cd4cc53d9829 tempest-CinderUnicodeTest-1323509825 None] Lock "cinder-quobyte-4cd9bf36-7f91-4f0c-9816-6697b895e632" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:24:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-0a8e1c64-0923-4580-bccc-cd4cc53d9829 tempest-CinderUnicodeTest-1323509825 None] Deleting offline snapshot 4cd9bf36-7f91-4f0c-9816-6697b895e632 of volume 1e1243ed-3305-4a7a-a74a-6ae158c0fc97 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:24:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-0a8e1c64-0923-4580-bccc-cd4cc53d9829 tempest-CinderUnicodeTest-1323509825 None] snapshot_file for this snap is: volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.4cd9bf36-7f91-4f0c-9816-6697b895e632 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:24:42 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e6af1d-065d-4c02-8c89-f982d94b645d]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:24:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0a8e1c64-0923-4580-bccc-cd4cc53d9829 tempest-CinderUnicodeTest-1323509825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.4cd9bf36-7f91-4f0c-9816-6697b895e632 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:42 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.4cd9bf36-7f91-4f0c-9816-6697b895e632 Sep 09 18:24:42 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:43 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0a8e1c64-0923-4580-bccc-cd4cc53d9829 tempest-CinderUnicodeTest-1323509825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.4cd9bf36-7f91-4f0c-9816-6697b895e632" returned: 0 in 0.476s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-0a8e1c64-0923-4580-bccc-cd4cc53d9829 tempest-CinderUnicodeTest-1323509825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:24:43 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35bf0da-c337-4a90-867d-09d44878c7ab]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:24:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0a8e1c64-0923-4580-bccc-cd4cc53d9829 tempest-CinderUnicodeTest-1323509825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:24:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:24:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:24:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:43 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97 Sep 09 18:24:43 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:43 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:24:43 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:43 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.392s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:24:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:24:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 29 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:24:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:24:43 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0a8e1c64-0923-4580-bccc-cd4cc53d9829 tempest-CinderUnicodeTest-1323509825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97" returned: 0 in 0.554s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0a8e1c64-0923-4580-bccc-cd4cc53d9829 tempest-CinderUnicodeTest-1323509825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.4cd9bf36-7f91-4f0c-9816-6697b895e632 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:43 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.4cd9bf36-7f91-4f0c-9816-6697b895e632 Sep 09 18:24:43 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:44 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0a8e1c64-0923-4580-bccc-cd4cc53d9829 tempest-CinderUnicodeTest-1323509825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.4cd9bf36-7f91-4f0c-9816-6697b895e632" returned: 0 in 0.343s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0a8e1c64-0923-4580-bccc-cd4cc53d9829 tempest-CinderUnicodeTest-1323509825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.4cd9bf36-7f91-4f0c-9816-6697b895e632 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:44 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.4cd9bf36-7f91-4f0c-9816-6697b895e632 Sep 09 18:24:44 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:44 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0a8e1c64-0923-4580-bccc-cd4cc53d9829 tempest-CinderUnicodeTest-1323509825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97.4cd9bf36-7f91-4f0c-9816-6697b895e632" returned: 0 in 0.268s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0a8e1c64-0923-4580-bccc-cd4cc53d9829 tempest-CinderUnicodeTest-1323509825 None] Lock "cinder-quobyte-4cd9bf36-7f91-4f0c-9816-6697b895e632" released by "_delete_snapshot" :: held 1.782s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:24:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0a8e1c64-0923-4580-bccc-cd4cc53d9829 tempest-CinderUnicodeTest-1323509825 None] Lock "cinder-quobyte-1e1243ed-3305-4a7a-a74a-6ae158c0fc97" released by "delete_snapshot" :: held 1.822s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:24:44 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-0a8e1c64-0923-4580-bccc-cd4cc53d9829 tempest-CinderUnicodeTest-1323509825 None] Created reservations ['fd464e33-c1af-4951-92a2-6899d391879c', 'fcabb318-2aef-4005-92b5-5b2319d6e932', '24f44a83-177c-43c0-afa8-0121ffc69f39', 'adb799f9-441a-4023-b946-95ebcfb60e1f'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:24:44 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-0a8e1c64-0923-4580-bccc-cd4cc53d9829 tempest-CinderUnicodeTest-1323509825 None] Delete snapshot completed successfully. Sep 09 18:24:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0a8e1c64-0923-4580-bccc-cd4cc53d9829 tempest-CinderUnicodeTest-1323509825 None] Lock "cinder-4cd9bf36-7f91-4f0c-9816-6697b895e632-delete_snapshot" released by "delete_snapshot" :: held 1.996s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:24:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-cc2b0e83-74df-4423-9b69-6287df1daf06 tempest-CinderUnicodeTest-1323509825 None] Acquiring lock "cinder-1e1243ed-3305-4a7a-a74a-6ae158c0fc97-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:24:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-cc2b0e83-74df-4423-9b69-6287df1daf06 tempest-CinderUnicodeTest-1323509825 None] Lock "cinder-1e1243ed-3305-4a7a-a74a-6ae158c0fc97-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:24:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-cc2b0e83-74df-4423-9b69-6287df1daf06 tempest-CinderUnicodeTest-1323509825 None] Acquiring lock "cinder-quobyte-1e1243ed-3305-4a7a-a74a-6ae158c0fc97" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:24:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-cc2b0e83-74df-4423-9b69-6287df1daf06 tempest-CinderUnicodeTest-1323509825 None] Lock "cinder-quobyte-1e1243ed-3305-4a7a-a74a-6ae158c0fc97" acquired by "delete_volume" :: waited 0.022s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:24:44 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3148700f-f734-4d4d-ba7a-3441a87aa17a]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:24:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2b0e83-74df-4423-9b69-6287df1daf06 tempest-CinderUnicodeTest-1323509825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:45 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97 Sep 09 18:24:45 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:45 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2b0e83-74df-4423-9b69-6287df1daf06 tempest-CinderUnicodeTest-1323509825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97" returned: 0 in 0.448s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2b0e83-74df-4423-9b69-6287df1daf06 tempest-CinderUnicodeTest-1323509825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:45 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97 Sep 09 18:24:45 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:45 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2b0e83-74df-4423-9b69-6287df1daf06 tempest-CinderUnicodeTest-1323509825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1e1243ed-3305-4a7a-a74a-6ae158c0fc97" returned: 0 in 0.294s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-cc2b0e83-74df-4423-9b69-6287df1daf06 tempest-CinderUnicodeTest-1323509825 None] Lock "cinder-quobyte-1e1243ed-3305-4a7a-a74a-6ae158c0fc97" released by "delete_volume" :: held 0.821s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:24:45 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-cc2b0e83-74df-4423-9b69-6287df1daf06 tempest-CinderUnicodeTest-1323509825 None] Created reservations ['d449e685-8343-4707-a295-01fdfdb677f0', '5d583652-af6d-4e38-9cd8-34f16ee04ba3', 'b910e25e-83e5-4958-a471-17add375e0cf', '65bd1937-fcee-4a65-9c1b-69a7b0cf3e5d'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:24:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2b0e83-74df-4423-9b69-6287df1daf06 tempest-CinderUnicodeTest-1323509825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2b0e83-74df-4423-9b69-6287df1daf06 tempest-CinderUnicodeTest-1323509825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2b0e83-74df-4423-9b69-6287df1daf06 tempest-CinderUnicodeTest-1323509825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:24:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2b0e83-74df-4423-9b69-6287df1daf06 tempest-CinderUnicodeTest-1323509825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:24:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2b0e83-74df-4423-9b69-6287df1daf06 tempest-CinderUnicodeTest-1323509825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2b0e83-74df-4423-9b69-6287df1daf06 tempest-CinderUnicodeTest-1323509825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:45 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:24:45 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5e9f3c03-d1fa-48f2-9e4e-d0b8fb3f1165 tempest-CinderUnicodeTest-1323509825 None] Acquiring lock "cinder-20c9cde5-29f7-423c-9a7c-a52cd70d7ff0-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:24:46 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5e9f3c03-d1fa-48f2-9e4e-d0b8fb3f1165 tempest-CinderUnicodeTest-1323509825 None] Lock "cinder-20c9cde5-29f7-423c-9a7c-a52cd70d7ff0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:24:46 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5e9f3c03-d1fa-48f2-9e4e-d0b8fb3f1165 tempest-CinderUnicodeTest-1323509825 None] Acquiring lock "cinder-quobyte-20c9cde5-29f7-423c-9a7c-a52cd70d7ff0" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:24:46 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5e9f3c03-d1fa-48f2-9e4e-d0b8fb3f1165 tempest-CinderUnicodeTest-1323509825 None] Lock "cinder-quobyte-20c9cde5-29f7-423c-9a7c-a52cd70d7ff0" acquired by "delete_volume" :: waited 0.026s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:24:46 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2b0e83-74df-4423-9b69-6287df1daf06 tempest-CinderUnicodeTest-1323509825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.304s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:46 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2b0e83-74df-4423-9b69-6287df1daf06 tempest-CinderUnicodeTest-1323509825 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:24:46 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-cc2b0e83-74df-4423-9b69-6287df1daf06 tempest-CinderUnicodeTest-1323509825 None] Deleted volume successfully. Sep 09 18:24:46 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82e7f81-8e4f-4230-b87f-26962efdcc91]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:24:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5e9f3c03-d1fa-48f2-9e4e-d0b8fb3f1165 tempest-CinderUnicodeTest-1323509825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-20c9cde5-29f7-423c-9a7c-a52cd70d7ff0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:46 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-cc2b0e83-74df-4423-9b69-6287df1daf06 tempest-CinderUnicodeTest-1323509825 None] Lock "cinder-1e1243ed-3305-4a7a-a74a-6ae158c0fc97-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:24:46 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-20c9cde5-29f7-423c-9a7c-a52cd70d7ff0 Sep 09 18:24:46 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:46 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5e9f3c03-d1fa-48f2-9e4e-d0b8fb3f1165 tempest-CinderUnicodeTest-1323509825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-20c9cde5-29f7-423c-9a7c-a52cd70d7ff0" returned: 0 in 0.365s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5e9f3c03-d1fa-48f2-9e4e-d0b8fb3f1165 tempest-CinderUnicodeTest-1323509825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-20c9cde5-29f7-423c-9a7c-a52cd70d7ff0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:46 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-20c9cde5-29f7-423c-9a7c-a52cd70d7ff0 Sep 09 18:24:46 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:46 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5e9f3c03-d1fa-48f2-9e4e-d0b8fb3f1165 tempest-CinderUnicodeTest-1323509825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-20c9cde5-29f7-423c-9a7c-a52cd70d7ff0" returned: 0 in 0.250s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:46 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5e9f3c03-d1fa-48f2-9e4e-d0b8fb3f1165 tempest-CinderUnicodeTest-1323509825 None] Lock "cinder-quobyte-20c9cde5-29f7-423c-9a7c-a52cd70d7ff0" released by "delete_volume" :: held 0.673s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:24:46 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-5e9f3c03-d1fa-48f2-9e4e-d0b8fb3f1165 tempest-CinderUnicodeTest-1323509825 None] Created reservations ['b20b633a-b97b-4ae9-ac45-f202004f97db', 'f3ad977b-05c8-4d4f-abf8-5aa4b20faf2a', '8700cd15-08e3-41db-a2c5-ea7d34cd4b67', '7349dbdb-035d-40ed-8758-49cff5d1a471'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:24:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5e9f3c03-d1fa-48f2-9e4e-d0b8fb3f1165 tempest-CinderUnicodeTest-1323509825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5e9f3c03-d1fa-48f2-9e4e-d0b8fb3f1165 tempest-CinderUnicodeTest-1323509825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:46 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5e9f3c03-d1fa-48f2-9e4e-d0b8fb3f1165 tempest-CinderUnicodeTest-1323509825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:24:46 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5e9f3c03-d1fa-48f2-9e4e-d0b8fb3f1165 tempest-CinderUnicodeTest-1323509825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:24:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5e9f3c03-d1fa-48f2-9e4e-d0b8fb3f1165 tempest-CinderUnicodeTest-1323509825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5e9f3c03-d1fa-48f2-9e4e-d0b8fb3f1165 tempest-CinderUnicodeTest-1323509825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:46 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:24:46 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:47 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5e9f3c03-d1fa-48f2-9e4e-d0b8fb3f1165 tempest-CinderUnicodeTest-1323509825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.351s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:47 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-5e9f3c03-d1fa-48f2-9e4e-d0b8fb3f1165 tempest-CinderUnicodeTest-1323509825 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:24:47 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-5e9f3c03-d1fa-48f2-9e4e-d0b8fb3f1165 tempest-CinderUnicodeTest-1323509825 None] Deleted volume successfully. Sep 09 18:24:47 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5e9f3c03-d1fa-48f2-9e4e-d0b8fb3f1165 tempest-CinderUnicodeTest-1323509825 None] Lock "cinder-20c9cde5-29f7-423c-9a7c-a52cd70d7ff0-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:24:53 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-2cdde25d-5c58-4e28-a300-aee261d49623 req-784cf8f2-5b0f-498b-a6e0-828d9fb9d8d1 tempest-TestMinimumBasicScenario-389590853 None] Terminate volume connection completed successfully. Sep 09 18:24:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-2cdde25d-5c58-4e28-a300-aee261d49623 req-784cf8f2-5b0f-498b-a6e0-828d9fb9d8d1 tempest-TestMinimumBasicScenario-389590853 None] Deleting attachment 634d9900-c256-4a26-b9bb-fe55309193f8. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:24:54 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fd71f513-5890-456a-a22c-6f197d02f040 tempest-TestMinimumBasicScenario-389590853 None] Acquiring lock "cinder-afbe654d-f320-4ffc-b470-de4534508278-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:24:54 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fd71f513-5890-456a-a22c-6f197d02f040 tempest-TestMinimumBasicScenario-389590853 None] Lock "cinder-afbe654d-f320-4ffc-b470-de4534508278-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:24:54 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fd71f513-5890-456a-a22c-6f197d02f040 tempest-TestMinimumBasicScenario-389590853 None] Acquiring lock "cinder-quobyte-afbe654d-f320-4ffc-b470-de4534508278" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:24:54 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fd71f513-5890-456a-a22c-6f197d02f040 tempest-TestMinimumBasicScenario-389590853 None] Lock "cinder-quobyte-afbe654d-f320-4ffc-b470-de4534508278" acquired by "delete_volume" :: waited 0.027s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:24:54 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0750a9e-6b33-4540-8dbe-f9033d222c8d]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:24:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fd71f513-5890-456a-a22c-6f197d02f040 tempest-TestMinimumBasicScenario-389590853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-afbe654d-f320-4ffc-b470-de4534508278 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:54 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-afbe654d-f320-4ffc-b470-de4534508278 Sep 09 18:24:54 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:54 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fd71f513-5890-456a-a22c-6f197d02f040 tempest-TestMinimumBasicScenario-389590853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-afbe654d-f320-4ffc-b470-de4534508278" returned: 0 in 0.358s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fd71f513-5890-456a-a22c-6f197d02f040 tempest-TestMinimumBasicScenario-389590853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-afbe654d-f320-4ffc-b470-de4534508278 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:54 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-afbe654d-f320-4ffc-b470-de4534508278 Sep 09 18:24:54 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:55 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fd71f513-5890-456a-a22c-6f197d02f040 tempest-TestMinimumBasicScenario-389590853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-afbe654d-f320-4ffc-b470-de4534508278" returned: 0 in 0.247s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fd71f513-5890-456a-a22c-6f197d02f040 tempest-TestMinimumBasicScenario-389590853 None] Lock "cinder-quobyte-afbe654d-f320-4ffc-b470-de4534508278" released by "delete_volume" :: held 0.665s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:24:55 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-fd71f513-5890-456a-a22c-6f197d02f040 tempest-TestMinimumBasicScenario-389590853 None] Created reservations ['9eea22f2-2bef-4066-8376-199a66bc177d', '939e798a-13bf-4eb6-a511-0a514456bf73', '85d3936f-b7c1-4c19-9879-3c177342152c', 'd096bb60-94c1-435a-93c5-ab3c58c2b8d6'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:24:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fd71f513-5890-456a-a22c-6f197d02f040 tempest-TestMinimumBasicScenario-389590853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:24:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fd71f513-5890-456a-a22c-6f197d02f040 tempest-TestMinimumBasicScenario-389590853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:24:55 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fd71f513-5890-456a-a22c-6f197d02f040 tempest-TestMinimumBasicScenario-389590853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:24:55 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fd71f513-5890-456a-a22c-6f197d02f040 tempest-TestMinimumBasicScenario-389590853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:24:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fd71f513-5890-456a-a22c-6f197d02f040 tempest-TestMinimumBasicScenario-389590853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:24:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fd71f513-5890-456a-a22c-6f197d02f040 tempest-TestMinimumBasicScenario-389590853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:24:55 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:24:55 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:24:55 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Sep 09 18:24:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fd71f513-5890-456a-a22c-6f197d02f040 tempest-TestMinimumBasicScenario-389590853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.277s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:24:55 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-fd71f513-5890-456a-a22c-6f197d02f040 tempest-TestMinimumBasicScenario-389590853 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:24:55 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-fd71f513-5890-456a-a22c-6f197d02f040 tempest-TestMinimumBasicScenario-389590853 None] Deleted volume successfully. Sep 09 18:24:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fd71f513-5890-456a-a22c-6f197d02f040 tempest-TestMinimumBasicScenario-389590853 None] Lock "cinder-afbe654d-f320-4ffc-b470-de4534508278-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:25:05 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=61,cinder:DELETE=8,cinder:UPDATE=65,cinder:INSERT=22 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:25:05 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=58,cinder:UPDATE=81,cinder:INSERT=22,cinder:DELETE=4 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:25:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-b929da6f-30f5-45f4-a682-3d63be17f6bf req-ece714f8-140c-4a4a-a959-c02b6e043b57 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:25:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-b929da6f-30f5-45f4-a682-3d63be17f6bf req-ece714f8-140c-4a4a-a959-c02b6e043b57 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:25:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-b929da6f-30f5-45f4-a682-3d63be17f6bf req-ece714f8-140c-4a4a-a959-c02b6e043b57 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:25:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-b929da6f-30f5-45f4-a682-3d63be17f6bf req-ece714f8-140c-4a4a-a959-c02b6e043b57 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-db29b72b-de23-44a3-b5a0-ba907a66a668', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5121e0c-4191-4e30-a8f3-02612f6edfb3', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:25:06 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-b929da6f-30f5-45f4-a682-3d63be17f6bf req-ece714f8-140c-4a4a-a959-c02b6e043b57 tempest-TestServerVolumeAttachmentScenario-1386237045 None] attachment_update completed successfully. Sep 09 18:25:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-e8b0f3b0-eb73-431c-b332-1c1716a3567a req-7acfcd0b-50bb-4bd4-86c2-06090f80d394 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:25:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-e8b0f3b0-eb73-431c-b332-1c1716a3567a req-7acfcd0b-50bb-4bd4-86c2-06090f80d394 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:25:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-e8b0f3b0-eb73-431c-b332-1c1716a3567a req-7acfcd0b-50bb-4bd4-86c2-06090f80d394 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:25:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-e8b0f3b0-eb73-431c-b332-1c1716a3567a req-7acfcd0b-50bb-4bd4-86c2-06090f80d394 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-03f3a6ff-5d72-4483-8808-272b82e68d7a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee69fac7-c6dc-4424-93bb-a03ae5232b42', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:25:12 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-e8b0f3b0-eb73-431c-b332-1c1716a3567a req-7acfcd0b-50bb-4bd4-86c2-06090f80d394 tempest-TestServerVolumeAttachmentScenario-1386237045 None] attachment_update completed successfully. Sep 09 18:25:13 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-9083a496-c16e-41d6-9a0a-c8af1b218c94 req-c3f41ec7-783f-4b8a-a3fe-794f44ce7a23 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Terminate volume connection completed successfully. Sep 09 18:25:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-9083a496-c16e-41d6-9a0a-c8af1b218c94 req-c3f41ec7-783f-4b8a-a3fe-794f44ce7a23 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Deleting attachment ee69fac7-c6dc-4424-93bb-a03ae5232b42. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:25:15 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-54204741-a358-44df-82ef-07bb5baca581 req-4b65cccd-60cb-43ab-b56d-c1b048053bb5 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Terminate volume connection completed successfully. Sep 09 18:25:15 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-54204741-a358-44df-82ef-07bb5baca581 req-4b65cccd-60cb-43ab-b56d-c1b048053bb5 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Deleting attachment e5121e0c-4191-4e30-a8f3-02612f6edfb3. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:25:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-57425c17-c0b9-49c2-8db1-0e7f5de00227 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Acquiring lock "cinder-03f3a6ff-5d72-4483-8808-272b82e68d7a-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:25:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-57425c17-c0b9-49c2-8db1-0e7f5de00227 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "cinder-03f3a6ff-5d72-4483-8808-272b82e68d7a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:25:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-57425c17-c0b9-49c2-8db1-0e7f5de00227 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Acquiring lock "cinder-quobyte-03f3a6ff-5d72-4483-8808-272b82e68d7a" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:25:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-57425c17-c0b9-49c2-8db1-0e7f5de00227 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "cinder-quobyte-03f3a6ff-5d72-4483-8808-272b82e68d7a" acquired by "delete_volume" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:25:21 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcb5ce9-97d4-44f8-a15a-eac1a4b29e22]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:25:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-57425c17-c0b9-49c2-8db1-0e7f5de00227 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03f3a6ff-5d72-4483-8808-272b82e68d7a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:25:21 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03f3a6ff-5d72-4483-8808-272b82e68d7a Sep 09 18:25:21 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:25:21 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Sep 09 18:25:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-57425c17-c0b9-49c2-8db1-0e7f5de00227 tempest-TestServerVolumeAttachmentScenario-1386237045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03f3a6ff-5d72-4483-8808-272b82e68d7a" returned: 0 in 0.363s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:25:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-57425c17-c0b9-49c2-8db1-0e7f5de00227 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03f3a6ff-5d72-4483-8808-272b82e68d7a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:25:21 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03f3a6ff-5d72-4483-8808-272b82e68d7a Sep 09 18:25:21 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:25:22 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Sep 09 18:25:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-57425c17-c0b9-49c2-8db1-0e7f5de00227 tempest-TestServerVolumeAttachmentScenario-1386237045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-03f3a6ff-5d72-4483-8808-272b82e68d7a" returned: 0 in 0.263s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:25:22 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-57425c17-c0b9-49c2-8db1-0e7f5de00227 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "cinder-quobyte-03f3a6ff-5d72-4483-8808-272b82e68d7a" released by "delete_volume" :: held 0.690s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:25:22 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-57425c17-c0b9-49c2-8db1-0e7f5de00227 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Created reservations ['a2527e29-eded-4cda-8afb-4aa92dad3c7c', '214f7aaa-1f04-4490-8b60-f560820f870c', 'b4f56a3a-e2f7-4e81-8823-72adfb484f9e', '1d509c8f-5422-4207-a164-bb94642f7f2d'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:25:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-57425c17-c0b9-49c2-8db1-0e7f5de00227 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:25:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-57425c17-c0b9-49c2-8db1-0e7f5de00227 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:25:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-57425c17-c0b9-49c2-8db1-0e7f5de00227 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:25:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-57425c17-c0b9-49c2-8db1-0e7f5de00227 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:25:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-57425c17-c0b9-49c2-8db1-0e7f5de00227 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:25:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-57425c17-c0b9-49c2-8db1-0e7f5de00227 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:25:22 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:25:22 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:25:22 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-54337195-6a10-4566-b240-130727456ce5 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Acquiring lock "cinder-db29b72b-de23-44a3-b5a0-ba907a66a668-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:25:22 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Sep 09 18:25:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-57425c17-c0b9-49c2-8db1-0e7f5de00227 tempest-TestServerVolumeAttachmentScenario-1386237045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.295s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:25:22 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-57425c17-c0b9-49c2-8db1-0e7f5de00227 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:25:22 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-57425c17-c0b9-49c2-8db1-0e7f5de00227 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Deleted volume successfully. Sep 09 18:25:22 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-54337195-6a10-4566-b240-130727456ce5 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "cinder-db29b72b-de23-44a3-b5a0-ba907a66a668-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:25:22 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-57425c17-c0b9-49c2-8db1-0e7f5de00227 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "cinder-03f3a6ff-5d72-4483-8808-272b82e68d7a-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:25:22 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-54337195-6a10-4566-b240-130727456ce5 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Acquiring lock "cinder-quobyte-db29b72b-de23-44a3-b5a0-ba907a66a668" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:25:22 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-54337195-6a10-4566-b240-130727456ce5 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "cinder-quobyte-db29b72b-de23-44a3-b5a0-ba907a66a668" acquired by "delete_volume" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:25:22 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1e41be-8e09-4a0f-aeff-759f6f1c4bbb]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:25:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-54337195-6a10-4566-b240-130727456ce5 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-db29b72b-de23-44a3-b5a0-ba907a66a668 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:25:22 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-db29b72b-de23-44a3-b5a0-ba907a66a668 Sep 09 18:25:22 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:25:23 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Sep 09 18:25:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-54337195-6a10-4566-b240-130727456ce5 tempest-TestServerVolumeAttachmentScenario-1386237045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-db29b72b-de23-44a3-b5a0-ba907a66a668" returned: 0 in 0.355s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:25:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-54337195-6a10-4566-b240-130727456ce5 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-db29b72b-de23-44a3-b5a0-ba907a66a668 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:25:23 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-db29b72b-de23-44a3-b5a0-ba907a66a668 Sep 09 18:25:23 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:25:23 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Sep 09 18:25:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-54337195-6a10-4566-b240-130727456ce5 tempest-TestServerVolumeAttachmentScenario-1386237045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-db29b72b-de23-44a3-b5a0-ba907a66a668" returned: 0 in 0.249s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:25:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-54337195-6a10-4566-b240-130727456ce5 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "cinder-quobyte-db29b72b-de23-44a3-b5a0-ba907a66a668" released by "delete_volume" :: held 0.645s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:25:23 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-54337195-6a10-4566-b240-130727456ce5 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Created reservations ['cb75e6c3-7168-4dba-becf-02dcb88791d9', '1735ecf5-3fdc-43ef-b080-cc4db96cf388', 'f1dcf962-a64d-4636-8bd4-03fd75c32b27', '94291157-bc40-4856-94ec-f030f8ec7c5b'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:25:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-54337195-6a10-4566-b240-130727456ce5 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:25:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-54337195-6a10-4566-b240-130727456ce5 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:25:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-54337195-6a10-4566-b240-130727456ce5 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:25:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-54337195-6a10-4566-b240-130727456ce5 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:25:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-54337195-6a10-4566-b240-130727456ce5 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:25:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-54337195-6a10-4566-b240-130727456ce5 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:25:23 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:25:23 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:25:23 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Sep 09 18:25:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-54337195-6a10-4566-b240-130727456ce5 tempest-TestServerVolumeAttachmentScenario-1386237045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.310s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:25:23 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-54337195-6a10-4566-b240-130727456ce5 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:25:23 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-54337195-6a10-4566-b240-130727456ce5 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Deleted volume successfully. Sep 09 18:25:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-54337195-6a10-4566-b240-130727456ce5 tempest-TestServerVolumeAttachmentScenario-1386237045 None] Lock "cinder-db29b72b-de23-44a3-b5a0-ba907a66a668-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:25:33 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=24,cinder:UPDATE=17,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:25:33 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=26,cinder:UPDATE=21,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:25:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:25:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:25:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:25:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:25:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:25:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:25:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:25:43 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:25:43 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:25:43 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Sep 09 18:25:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.332s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:25:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:25:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:25:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 29 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:25:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Flow 'volume_create_manager' (06423a88-caf2-46a3-88c9-88cd51d5601a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777a63de-42df-4543-8b32-274014b85cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777a63de-42df-4543-8b32-274014b85cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1731163985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc6c97c-9b8c-4cc2-9e16-8bef190cb800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe562d5633d4bc2bde7b9f8896ec643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:26:02Z,use_quota=True,user_id='c09b6f0a187b42f1b4d204c1e96ccb12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4824fd78-ad30-4755-8f15-701e327b2aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4824fd78-ad30-4755-8f15-701e327b2aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d5a83a3-538b-45a4-973f-6e12fca5d20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.image.glance [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Creating Keystone auth plugin from conf {{(pid=87639) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Flow 'volume_create_manager' (541a9c86-a327-400f-b5c7-ee92869fa57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53718505-c6bd-4afc-9808-786a773bc697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53718505-c6bd-4afc-9808-786a773bc697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1021728330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bb4e6c-90d3-494f-9236-9ea098e568a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff11048c529a43cbba40ac5ad47e4eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:26:03Z,use_quota=True,user_id='128abcd17b174e8fb84d3bfa3bca015b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8c40c3-f619-42fb-8e52-a7fb7be430b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f8c40c3-f619-42fb-8e52-a7fb7be430b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5cb27f-a16f-4612-a561-6b3a089e6f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5cb27f-a16f-4612-a561-6b3a089e6f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2bb4e6c-90d3-494f-9236-9ea098e568a9', 'volume_name': 'volume-d2bb4e6c-90d3-494f-9236-9ea098e568a9', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18047ef-360d-4402-9242-dceb3a13929c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18047ef-360d-4402-9242-dceb3a13929c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f198619-d9af-408c-9d44-acd5ba51ae88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:26:02 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Volume d2bb4e6c-90d3-494f-9236-9ea098e568a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2bb4e6c-90d3-494f-9236-9ea098e568a9', 'volume_size': 1} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1021728330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bb4e6c-90d3-494f-9236-9ea098e568a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff11048c529a43cbba40ac5ad47e4eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:26:03Z,use_quota=True,user_id='128abcd17b174e8fb84d3bfa3bca015b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Creating volume d2bb4e6c-90d3-494f-9236-9ea098e568a9 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:26:02 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d2bb4e6c-90d3-494f-9236-9ea098e568a9 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:26:02 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d2bb4e6c-90d3-494f-9236-9ea098e568a9 1073741824 Sep 09 18:26:02 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d5a83a3-538b-45a4-973f-6e12fca5d20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7cc6c97c-9b8c-4cc2-9e16-8bef190cb800', 'volume_name': 'volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800', 'volume_size': 1, 'image_id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7ff1e5c089804fe694a8f7d1bf0a7374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'created_at': datetime.datetime(2026, 9, 9, 16, 5, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 5, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45d4449-438e-4196-b7c2-89a9847e2ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45d4449-438e-4196-b7c2-89a9847e2ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c60c26d5-1d9c-4233-8600-7b7838d25c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:26:02 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Volume 7cc6c97c-9b8c-4cc2-9e16-8bef190cb800: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800', 'volume_size': 1, 'image_id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7ff1e5c089804fe694a8f7d1bf0a7374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'created_at': datetime.datetime(2026, 9, 9, 16, 5, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 5, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 18:26:02 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Trying to clone 7cc6c97c-9b8c-4cc2-9e16-8bef190cb800 from image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}]). {{(pid=87639) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1__uj5y411devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 18:26:03 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Image download 20.69 MB at 20.69 MB/s Sep 09 18:26:03 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d2bb4e6c-90d3-494f-9236-9ea098e568a9 1073741824" returned: 0 in 0.459s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdf6d20-a367-4b38-9423-cdd4a1f0ff87]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1__uj5y411devstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d2bb4e6c-90d3-494f-9236-9ea098e568a9 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:26:03 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d2bb4e6c-90d3-494f-9236-9ea098e568a9 Sep 09 18:26:03 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:26:03 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1__uj5y411devstack@QuobyteHD Sep 09 18:26:03 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:26:03 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d2bb4e6c-90d3-494f-9236-9ea098e568a9" returned: 0 in 0.251s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f198619-d9af-408c-9d44-acd5ba51ae88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2bb4e6c-90d3-494f-9236-9ea098e568a9', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca957000-4faa-4737-bb81-3c0cf28cb6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:26:03 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Volume volume-d2bb4e6c-90d3-494f-9236-9ea098e568a9 (d2bb4e6c-90d3-494f-9236-9ea098e568a9): created successfully Sep 09 18:26:03 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca957000-4faa-4737-bb81-3c0cf28cb6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Flow 'volume_create_manager' (541a9c86-a327-400f-b5c7-ee92869fa57e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1__uj5y411devstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Temporary image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 is fetched for user c09b6f0a187b42f1b4d204c1e96ccb12. {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 18:26:03 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-7590dbba-ea22-419d-800f-27313b0b85b2 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Created volume successfully. Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bec1601-5727-4056-ab94-e690cdbd8f4f]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1__uj5y411devstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:26:03 devstack sudo[103524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1__uj5y411devstack@QuobyteHD Sep 09 18:26:03 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:26:03 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1__uj5y411devstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1731163985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc6c97c-9b8c-4cc2-9e16-8bef190cb800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe562d5633d4bc2bde7b9f8896ec643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:26:02Z,use_quota=True,user_id='c09b6f0a187b42f1b4d204c1e96ccb12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Creating volume 7cc6c97c-9b8c-4cc2-9e16-8bef190cb800 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:26:03 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:26:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:26:04 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800 1073741824 Sep 09 18:26:04 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:26:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-05f784ed-1aaf-4e86-bb53-6f6df1a127c4 req-8169f609-f353-4b53-97a4-cde3d05f3343 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:26:04 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Sep 09 18:26:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800 1073741824" returned: 0 in 0.428s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:26:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:26:04 devstack sudo[103547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800 Sep 09 18:26:04 devstack sudo[103547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:26:04 devstack sudo[103547]: pam_unix(sudo:session): session closed for user root Sep 09 18:26:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800" returned: 0 in 0.243s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:26:04 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:26:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:26:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-05f784ed-1aaf-4e86-bb53-6f6df1a127c4 req-8169f609-f353-4b53-97a4-cde3d05f3343 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.318s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:26:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-05f784ed-1aaf-4e86-bb53-6f6df1a127c4 req-8169f609-f353-4b53-97a4-cde3d05f3343 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:26:04 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Attempting download of 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 ((None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}])) to volume 7cc6c97c-9b8c-4cc2-9e16-8bef190cb800. {{(pid=87639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 18:26:04 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-05f784ed-1aaf-4e86-bb53-6f6df1a127c4 req-8169f609-f353-4b53-97a4-cde3d05f3343 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-d2bb4e6c-90d3-494f-9236-9ea098e568a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1db1761c-af8b-4f63-aebd-4251111e903e', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:26:04 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[80019844-f5d2-4944-a8ec-c190e2d2b5dc]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:26:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_yqnptxmt {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:26:04 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-05f784ed-1aaf-4e86-bb53-6f6df1a127c4 req-8169f609-f353-4b53-97a4-cde3d05f3343 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] attachment_update completed successfully. Sep 09 18:26:04 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_yqnptxmt Sep 09 18:26:04 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:26:05 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Sep 09 18:26:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_yqnptxmt" returned: 0 in 0.358s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:26:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_yqnptxmt {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:26:05 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_yqnptxmt Sep 09 18:26:05 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:26:05 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Sep 09 18:26:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_yqnptxmt" returned: 1 in 0.413s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:26:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77e1b71c-9f5b-4ec9-9528-d1d29447deb1_yqnptxmt' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:26:05 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[546c583c-79ad-4568-9e09-6237955eb9db]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:26:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1__uj5y411devstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:26:05 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1__uj5y411devstack@QuobyteHD Sep 09 18:26:05 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:26:05 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Sep 09 18:26:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1__uj5y411devstack@QuobyteHD" returned: 0 in 0.345s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:26:05 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 was qcow2, converting to qcow2 {{(pid=87639) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 18:26:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1__uj5y411devstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:26:05 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1__uj5y411devstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800 Sep 09 18:26:05 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:26:07 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Sep 09 18:26:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1__uj5y411devstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800" returned: 0 in 1.763s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:26:07 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_77e1b71c-9f5b-4ec9-9528-d1d29447deb1__uj5y411devstack@QuobyteHD, size 112.00 MB, duration 1.77 sec, destination /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800 {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:26:07 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Converted 112.00 MB image at 63.43 MB/s Sep 09 18:26:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:26:07 devstack sudo[104025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800 1G Sep 09 18:26:07 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:26:07 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-b9d7500d-cb48-42eb-9ae5-1b6883063bdb req-3ac0026c-119d-4851-a80e-b74fb9e56e78 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Terminate volume connection completed successfully. Sep 09 18:26:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-b9d7500d-cb48-42eb-9ae5-1b6883063bdb req-3ac0026c-119d-4851-a80e-b74fb9e56e78 tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Deleting attachment 1db1761c-af8b-4f63-aebd-4251111e903e. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:26:07 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root Sep 09 18:26:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800 1G" returned: 0 in 0.329s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:26:07 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Downloaded image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 ((None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}])) to volume 7cc6c97c-9b8c-4cc2-9e16-8bef190cb800 successfully. {{(pid=87639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 18:26:07 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Temporary image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 for user c09b6f0a187b42f1b4d204c1e96ccb12 is deleted. {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 18:26:07 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Marking volume 7cc6c97c-9b8c-4cc2-9e16-8bef190cb800 as bootable. {{(pid=87639) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 18:26:08 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Copying metadata from image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 to 7cc6c97c-9b8c-4cc2-9e16-8bef190cb800. {{(pid=87639) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 18:26:08 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Creating volume glance metadata for volume 7cc6c97c-9b8c-4cc2-9e16-8bef190cb800 backed by image 77e1b71c-9f5b-4ec9-9528-d1d29447deb1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87639) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 18:26:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c60c26d5-1d9c-4233-8600-7b7838d25c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800', 'volume_size': 1, 'image_id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7ff1e5c089804fe694a8f7d1bf0a7374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77e1b71c-9f5b-4ec9-9528-d1d29447deb1', 'created_at': datetime.datetime(2026, 9, 9, 16, 5, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 5, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77e1b71c-9f5b-4ec9-9528-d1d29447deb1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:26:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc047eff-eeeb-4f4c-a4c5-18c8fc58cb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:26:08 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Volume volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800 (7cc6c97c-9b8c-4cc2-9e16-8bef190cb800): created successfully Sep 09 18:26:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc047eff-eeeb-4f4c-a4c5-18c8fc58cb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:26:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Flow 'volume_create_manager' (06423a88-caf2-46a3-88c9-88cd51d5601a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:26:08 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-547cdc07-f70c-47b3-8500-d2f3c5a55aa9 tempest-TestShelveInstance-237177468 None] Created volume successfully. Sep 09 18:26:08 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9c98d9cb-8e9d-420f-a952-60969e74ad0c tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Acquiring lock "cinder-d2bb4e6c-90d3-494f-9236-9ea098e568a9-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:26:08 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9c98d9cb-8e9d-420f-a952-60969e74ad0c tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Lock "cinder-d2bb4e6c-90d3-494f-9236-9ea098e568a9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:26:08 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9c98d9cb-8e9d-420f-a952-60969e74ad0c tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Acquiring lock "cinder-quobyte-d2bb4e6c-90d3-494f-9236-9ea098e568a9" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:26:08 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9c98d9cb-8e9d-420f-a952-60969e74ad0c tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Lock "cinder-quobyte-d2bb4e6c-90d3-494f-9236-9ea098e568a9" acquired by "delete_volume" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:26:08 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba04fef0-6a83-44a6-9144-607eef7d5002]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:26:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9c98d9cb-8e9d-420f-a952-60969e74ad0c tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d2bb4e6c-90d3-494f-9236-9ea098e568a9 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:26:08 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d2bb4e6c-90d3-494f-9236-9ea098e568a9 Sep 09 18:26:08 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:26:09 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Sep 09 18:26:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9c98d9cb-8e9d-420f-a952-60969e74ad0c tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d2bb4e6c-90d3-494f-9236-9ea098e568a9" returned: 0 in 0.376s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:26:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9c98d9cb-8e9d-420f-a952-60969e74ad0c tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d2bb4e6c-90d3-494f-9236-9ea098e568a9 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:26:09 devstack sudo[104036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d2bb4e6c-90d3-494f-9236-9ea098e568a9 Sep 09 18:26:09 devstack sudo[104036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:26:09 devstack sudo[104036]: pam_unix(sudo:session): session closed for user root Sep 09 18:26:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9c98d9cb-8e9d-420f-a952-60969e74ad0c tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d2bb4e6c-90d3-494f-9236-9ea098e568a9" returned: 0 in 0.258s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:26:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9c98d9cb-8e9d-420f-a952-60969e74ad0c tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Lock "cinder-quobyte-d2bb4e6c-90d3-494f-9236-9ea098e568a9" released by "delete_volume" :: held 0.679s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:26:09 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-9c98d9cb-8e9d-420f-a952-60969e74ad0c tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Created reservations ['32ae4953-7ce3-4cd3-a7d2-4234fc34ed05', '56f42441-313f-453c-9f6e-44ab3d24adeb', '5ce2debb-302c-460d-b615-ed7ceaadb16b', '39757ab7-bb26-4969-8426-aebda71ee863'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:26:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9c98d9cb-8e9d-420f-a952-60969e74ad0c tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:26:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9c98d9cb-8e9d-420f-a952-60969e74ad0c tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:26:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-9c98d9cb-8e9d-420f-a952-60969e74ad0c tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:26:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-9c98d9cb-8e9d-420f-a952-60969e74ad0c tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:26:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-9c98d9cb-8e9d-420f-a952-60969e74ad0c tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:26:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9c98d9cb-8e9d-420f-a952-60969e74ad0c tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:26:09 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:26:09 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:26:09 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Sep 09 18:26:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9c98d9cb-8e9d-420f-a952-60969e74ad0c tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.292s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:26:09 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-9c98d9cb-8e9d-420f-a952-60969e74ad0c tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:26:09 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-9c98d9cb-8e9d-420f-a952-60969e74ad0c tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Deleted volume successfully. Sep 09 18:26:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9c98d9cb-8e9d-420f-a952-60969e74ad0c tempest-TestServerVolumeAttachScenarioOldVersion-227259641 None] Lock "cinder-d2bb4e6c-90d3-494f-9236-9ea098e568a9-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:26:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-faa3f074-8862-4b99-b05f-7124be415cb2 req-c07e62a9-8bc7-478c-b994-894d7c7c2b56 tempest-TestShelveInstance-237177468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:26:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-faa3f074-8862-4b99-b05f-7124be415cb2 req-c07e62a9-8bc7-478c-b994-894d7c7c2b56 tempest-TestShelveInstance-237177468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:26:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-faa3f074-8862-4b99-b05f-7124be415cb2 req-c07e62a9-8bc7-478c-b994-894d7c7c2b56 tempest-TestShelveInstance-237177468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:26:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-faa3f074-8862-4b99-b05f-7124be415cb2 req-c07e62a9-8bc7-478c-b994-894d7c7c2b56 tempest-TestShelveInstance-237177468 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fbc258b4-7cd4-428a-9f1b-d9341b2294e4', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:26:11 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-faa3f074-8862-4b99-b05f-7124be415cb2 req-c07e62a9-8bc7-478c-b994-894d7c7c2b56 tempest-TestShelveInstance-237177468 None] attachment_update completed successfully. Sep 09 18:26:25 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:UPDATE=27,cinder:SELECT=28,cinder:INSERT=11,cinder:DELETE=1 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:26:25 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=34,cinder:UPDATE=11,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:26:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:26:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:26:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:26:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:26:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:26:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:26:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:26:43 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:26:43 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:26:43 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Sep 09 18:26:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.354s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:26:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:26:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:26:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 29 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:26:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:26:44 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-ad9bb7e6-6854-430d-8020-1d625beba7c1 req-af7ec99d-2c10-448c-a4ad-8dfa5dd03d86 tempest-TestShelveInstance-237177468 None] Terminate volume connection completed successfully. Sep 09 18:26:44 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-ad9bb7e6-6854-430d-8020-1d625beba7c1 req-af7ec99d-2c10-448c-a4ad-8dfa5dd03d86 tempest-TestShelveInstance-237177468 None] Deleting attachment fbc258b4-7cd4-428a-9f1b-d9341b2294e4. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:26:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-006f2365-d850-419d-86a4-56e810a155dc req-e98a1e5b-f3ea-4f7f-ad72-8d28e54b8da7 tempest-TestShelveInstance-237177468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:26:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-006f2365-d850-419d-86a4-56e810a155dc req-e98a1e5b-f3ea-4f7f-ad72-8d28e54b8da7 tempest-TestShelveInstance-237177468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:26:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-006f2365-d850-419d-86a4-56e810a155dc req-e98a1e5b-f3ea-4f7f-ad72-8d28e54b8da7 tempest-TestShelveInstance-237177468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:26:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-006f2365-d850-419d-86a4-56e810a155dc req-e98a1e5b-f3ea-4f7f-ad72-8d28e54b8da7 tempest-TestShelveInstance-237177468 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7080ce7f-b0c4-4bf5-b7a3-66ea1b730428', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:26:46 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-006f2365-d850-419d-86a4-56e810a155dc req-e98a1e5b-f3ea-4f7f-ad72-8d28e54b8da7 tempest-TestShelveInstance-237177468 None] attachment_update completed successfully. Sep 09 18:26:50 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:26:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Flow 'volume_create_manager' (5377cdfc-8118-48cd-acb0-63367f4c922a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:26:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ebe860-e15c-4af0-bcb0-f0fe639c0bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:26:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ebe860-e15c-4af0-bcb0-f0fe639c0bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1704397485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be075d4-d2e6-4b9f-8551-30b0cfc6486c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d11e256181e4c05837e73fa93ed4563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:26:50Z,use_quota=True,user_id='e8240dda8bee4897a920a7bd9d769a60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:26:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8689e55-8f2f-4306-85d6-47762538d344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:26:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8689e55-8f2f-4306-85d6-47762538d344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:26:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0b16eb-bfdd-47c1-8ec0-3ae48a3a15d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:26:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0b16eb-bfdd-47c1-8ec0-3ae48a3a15d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4be075d4-d2e6-4b9f-8551-30b0cfc6486c', 'volume_name': 'volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:26:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (999e7b45-3607-41c9-b237-3eb506e22838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:26:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (999e7b45-3607-41c9-b237-3eb506e22838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:26:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d5cdd1-f0ff-4e3b-930b-f0245c7b9e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:26:50 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Volume 4be075d4-d2e6-4b9f-8551-30b0cfc6486c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c', 'volume_size': 1} Sep 09 18:26:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:26:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:26:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1704397485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be075d4-d2e6-4b9f-8551-30b0cfc6486c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d11e256181e4c05837e73fa93ed4563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:26:50Z,use_quota=True,user_id='e8240dda8bee4897a920a7bd9d769a60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:26:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Creating volume 4be075d4-d2e6-4b9f-8551-30b0cfc6486c {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:26:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:26:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:26:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:26:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:26:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:26:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:26:50 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:26:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:26:50 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c 1073741824 Sep 09 18:26:50 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:26:51 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Sep 09 18:26:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c 1073741824" returned: 0 in 0.628s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:26:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:26:51 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c Sep 09 18:26:51 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:26:51 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Sep 09 18:26:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c" returned: 0 in 0.257s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:26:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:26:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:26:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d5cdd1-f0ff-4e3b-930b-f0245c7b9e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:26:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99a1f20-5ade-4141-9362-6b614206b53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:26:51 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Volume volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c (4be075d4-d2e6-4b9f-8551-30b0cfc6486c): created successfully Sep 09 18:26:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f99a1f20-5ade-4141-9362-6b614206b53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:26:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Flow 'volume_create_manager' (5377cdfc-8118-48cd-acb0-63367f4c922a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:26:51 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-fd12aa5b-5421-4113-9e99-cc89c929ae64 tempest-TestImageHashVerification-743339585 None] Created volume successfully. Sep 09 18:26:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e7fdc713-6109-4f74-9b47-dfd6c78bb72b tempest-TestImageHashVerification-743339585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:26:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e7fdc713-6109-4f74-9b47-dfd6c78bb72b tempest-TestImageHashVerification-743339585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:26:53 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a93b0e-5ffb-4704-99c6-141eee8650c5]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:26:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e7fdc713-6109-4f74-9b47-dfd6c78bb72b tempest-TestImageHashVerification-743339585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:26:53 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c Sep 09 18:26:53 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:26:53 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Sep 09 18:26:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e7fdc713-6109-4f74-9b47-dfd6c78bb72b tempest-TestImageHashVerification-743339585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c" returned: 0 in 0.388s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:26:53 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7669ad-50f6-4227-884b-b6b409165ddf]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:26:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e7fdc713-6109-4f74-9b47-dfd6c78bb72b tempest-TestImageHashVerification-743339585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:26:53 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c Sep 09 18:26:53 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:26:53 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Sep 09 18:26:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e7fdc713-6109-4f74-9b47-dfd6c78bb72b tempest-TestImageHashVerification-743339585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c" returned: 0 in 0.399s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:26:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e7fdc713-6109-4f74-9b47-dfd6c78bb72b tempest-TestImageHashVerification-743339585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c /opt/stack/data/cinder/conversion/4be075d4-d2e6-4b9f-8551-30b0cfc6486c.temp_image.ea5416e6-b80a-46f1-9453-7d61b770469dpteqahuf.img {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:26:53 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c /opt/stack/data/cinder/conversion/4be075d4-d2e6-4b9f-8551-30b0cfc6486c.temp_image.ea5416e6-b80a-46f1-9453-7d61b770469dpteqahuf.img Sep 09 18:26:53 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:26:58 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Sep 09 18:26:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e7fdc713-6109-4f74-9b47-dfd6c78bb72b tempest-TestImageHashVerification-743339585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c /opt/stack/data/cinder/conversion/4be075d4-d2e6-4b9f-8551-30b0cfc6486c.temp_image.ea5416e6-b80a-46f1-9453-7d61b770469dpteqahuf.img" returned: 0 in 4.411s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:26:58 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[002d5621-d37e-4d86-80eb-ac3ba73858a2]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:26:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e7fdc713-6109-4f74-9b47-dfd6c78bb72b tempest-TestImageHashVerification-743339585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:26:58 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c Sep 09 18:26:58 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:26:58 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Sep 09 18:26:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e7fdc713-6109-4f74-9b47-dfd6c78bb72b tempest-TestImageHashVerification-743339585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c" returned: 0 in 0.527s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:26:58 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-e7fdc713-6109-4f74-9b47-dfd6c78bb72b tempest-TestImageHashVerification-743339585 None] Image conversion details: src /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c, size 1024.00 MB, duration 4.41 sec, destination /opt/stack/data/cinder/conversion/4be075d4-d2e6-4b9f-8551-30b0cfc6486c.temp_image.ea5416e6-b80a-46f1-9453-7d61b770469dpteqahuf.img {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:26:58 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-e7fdc713-6109-4f74-9b47-dfd6c78bb72b tempest-TestImageHashVerification-743339585 None] Converted 1024.00 MB image at 232.07 MB/s Sep 09 18:26:58 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-e7fdc713-6109-4f74-9b47-dfd6c78bb72b tempest-TestImageHashVerification-743339585 None] ea5416e6-b80a-46f1-9453-7d61b770469d was raw, no need to convert to raw {{(pid=87639) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 09 18:27:03 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=8,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:27:08 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=14,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:27:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e7fdc713-6109-4f74-9b47-dfd6c78bb72b tempest-TestImageHashVerification-743339585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.955s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:27:18 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e7fdc713-6109-4f74-9b47-dfd6c78bb72b tempest-TestImageHashVerification-743339585 None] Uploaded volume to glance image-id: ea5416e6-b80a-46f1-9453-7d61b770469d. {{(pid=87639) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 09 18:27:18 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-e7fdc713-6109-4f74-9b47-dfd6c78bb72b tempest-TestImageHashVerification-743339585 None] Copy volume to image completed successfully. Sep 09 18:27:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4d69cc62-300a-4b7a-9f1b-80ff4fb78485 tempest-TestImageHashVerification-743339585 None] Acquiring lock "cinder-4be075d4-d2e6-4b9f-8551-30b0cfc6486c-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:27:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4d69cc62-300a-4b7a-9f1b-80ff4fb78485 tempest-TestImageHashVerification-743339585 None] Lock "cinder-4be075d4-d2e6-4b9f-8551-30b0cfc6486c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:27:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4d69cc62-300a-4b7a-9f1b-80ff4fb78485 tempest-TestImageHashVerification-743339585 None] Acquiring lock "cinder-quobyte-4be075d4-d2e6-4b9f-8551-30b0cfc6486c" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:27:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4d69cc62-300a-4b7a-9f1b-80ff4fb78485 tempest-TestImageHashVerification-743339585 None] Lock "cinder-quobyte-4be075d4-d2e6-4b9f-8551-30b0cfc6486c" acquired by "delete_volume" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:27:18 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f6bb19-ed29-45f9-9a6b-a73baec8434f]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:27:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4d69cc62-300a-4b7a-9f1b-80ff4fb78485 tempest-TestImageHashVerification-743339585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:27:18 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c Sep 09 18:27:18 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:27:19 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Sep 09 18:27:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4d69cc62-300a-4b7a-9f1b-80ff4fb78485 tempest-TestImageHashVerification-743339585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c" returned: 0 in 0.349s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:27:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4d69cc62-300a-4b7a-9f1b-80ff4fb78485 tempest-TestImageHashVerification-743339585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:27:19 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c Sep 09 18:27:19 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:27:19 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Sep 09 18:27:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4d69cc62-300a-4b7a-9f1b-80ff4fb78485 tempest-TestImageHashVerification-743339585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-4be075d4-d2e6-4b9f-8551-30b0cfc6486c" returned: 0 in 0.234s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:27:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4d69cc62-300a-4b7a-9f1b-80ff4fb78485 tempest-TestImageHashVerification-743339585 None] Lock "cinder-quobyte-4be075d4-d2e6-4b9f-8551-30b0cfc6486c" released by "delete_volume" :: held 0.616s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:27:19 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-4d69cc62-300a-4b7a-9f1b-80ff4fb78485 tempest-TestImageHashVerification-743339585 None] Created reservations ['ad26f472-1181-4c03-8813-56c64ec7baa0', '7aa1ff62-2bed-4e4c-86b7-1389befc5799', '5da87539-e8d1-42b0-a14f-46aad1f01a64', 'bec53e39-e76f-4cae-aeed-cefb7d81bf33'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:27:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4d69cc62-300a-4b7a-9f1b-80ff4fb78485 tempest-TestImageHashVerification-743339585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:27:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4d69cc62-300a-4b7a-9f1b-80ff4fb78485 tempest-TestImageHashVerification-743339585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:27:19 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4d69cc62-300a-4b7a-9f1b-80ff4fb78485 tempest-TestImageHashVerification-743339585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:27:19 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4d69cc62-300a-4b7a-9f1b-80ff4fb78485 tempest-TestImageHashVerification-743339585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:27:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4d69cc62-300a-4b7a-9f1b-80ff4fb78485 tempest-TestImageHashVerification-743339585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:27:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4d69cc62-300a-4b7a-9f1b-80ff4fb78485 tempest-TestImageHashVerification-743339585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:27:19 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:27:19 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:27:19 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Sep 09 18:27:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4d69cc62-300a-4b7a-9f1b-80ff4fb78485 tempest-TestImageHashVerification-743339585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.244s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:27:19 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-4d69cc62-300a-4b7a-9f1b-80ff4fb78485 tempest-TestImageHashVerification-743339585 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:27:19 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-4d69cc62-300a-4b7a-9f1b-80ff4fb78485 tempest-TestImageHashVerification-743339585 None] Deleted volume successfully. Sep 09 18:27:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-4d69cc62-300a-4b7a-9f1b-80ff4fb78485 tempest-TestImageHashVerification-743339585 None] Lock "cinder-4be075d4-d2e6-4b9f-8551-30b0cfc6486c-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:27:29 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:UPDATE=8,cinder:SELECT=4,cinder:INSERT=2 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:27:29 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:27:32 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-06cec42b-52c1-479a-b36a-92824d9b753f req-2bf02410-6793-488a-a7cd-c7e8b2b00f44 tempest-TestShelveInstance-237177468 None] Terminate volume connection completed successfully. Sep 09 18:27:32 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-06cec42b-52c1-479a-b36a-92824d9b753f req-2bf02410-6793-488a-a7cd-c7e8b2b00f44 tempest-TestShelveInstance-237177468 None] Deleting attachment 7080ce7f-b0c4-4bf5-b7a3-66ea1b730428. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:27:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-06cec42b-52c1-479a-b36a-92824d9b753f req-9e4549b8-e65f-435d-923b-b8af0f9f91a8 tempest-TestShelveInstance-237177468 None] Acquiring lock "cinder-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:27:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-06cec42b-52c1-479a-b36a-92824d9b753f req-9e4549b8-e65f-435d-923b-b8af0f9f91a8 tempest-TestShelveInstance-237177468 None] Lock "cinder-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:27:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-06cec42b-52c1-479a-b36a-92824d9b753f req-9e4549b8-e65f-435d-923b-b8af0f9f91a8 tempest-TestShelveInstance-237177468 None] Acquiring lock "cinder-quobyte-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:27:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-06cec42b-52c1-479a-b36a-92824d9b753f req-9e4549b8-e65f-435d-923b-b8af0f9f91a8 tempest-TestShelveInstance-237177468 None] Lock "cinder-quobyte-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800" acquired by "delete_volume" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:27:32 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d49aea-44ca-4785-8c94-ae444c9d653b]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:27:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-06cec42b-52c1-479a-b36a-92824d9b753f req-9e4549b8-e65f-435d-923b-b8af0f9f91a8 tempest-TestShelveInstance-237177468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:27:32 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800 Sep 09 18:27:32 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:27:33 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Sep 09 18:27:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-06cec42b-52c1-479a-b36a-92824d9b753f req-9e4549b8-e65f-435d-923b-b8af0f9f91a8 tempest-TestShelveInstance-237177468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800" returned: 0 in 0.388s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:27:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-06cec42b-52c1-479a-b36a-92824d9b753f req-9e4549b8-e65f-435d-923b-b8af0f9f91a8 tempest-TestShelveInstance-237177468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:27:33 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800 Sep 09 18:27:33 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:27:33 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Sep 09 18:27:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-06cec42b-52c1-479a-b36a-92824d9b753f req-9e4549b8-e65f-435d-923b-b8af0f9f91a8 tempest-TestShelveInstance-237177468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800" returned: 0 in 0.275s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:27:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-06cec42b-52c1-479a-b36a-92824d9b753f req-9e4549b8-e65f-435d-923b-b8af0f9f91a8 tempest-TestShelveInstance-237177468 None] Lock "cinder-quobyte-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800" released by "delete_volume" :: held 0.721s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:27:33 devstack cinder-volume[87639]: DEBUG cinder.quota [req-06cec42b-52c1-479a-b36a-92824d9b753f req-9e4549b8-e65f-435d-923b-b8af0f9f91a8 tempest-TestShelveInstance-237177468 None] Created reservations ['082cc049-d0ba-4456-845c-6479d5d842bf', '73d1989d-2f59-4a8e-ae28-c8efadc44ea1', '63779051-0ec0-452a-92ab-27ce0ccbe49c', '94134a81-ad17-4ede-a1f4-849f31ca1204'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:27:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-06cec42b-52c1-479a-b36a-92824d9b753f req-9e4549b8-e65f-435d-923b-b8af0f9f91a8 tempest-TestShelveInstance-237177468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:27:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-06cec42b-52c1-479a-b36a-92824d9b753f req-9e4549b8-e65f-435d-923b-b8af0f9f91a8 tempest-TestShelveInstance-237177468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:27:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [req-06cec42b-52c1-479a-b36a-92824d9b753f req-9e4549b8-e65f-435d-923b-b8af0f9f91a8 tempest-TestShelveInstance-237177468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:27:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [req-06cec42b-52c1-479a-b36a-92824d9b753f req-9e4549b8-e65f-435d-923b-b8af0f9f91a8 tempest-TestShelveInstance-237177468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:27:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-06cec42b-52c1-479a-b36a-92824d9b753f req-9e4549b8-e65f-435d-923b-b8af0f9f91a8 tempest-TestShelveInstance-237177468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:27:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-06cec42b-52c1-479a-b36a-92824d9b753f req-9e4549b8-e65f-435d-923b-b8af0f9f91a8 tempest-TestShelveInstance-237177468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:27:33 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:27:33 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:27:33 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Sep 09 18:27:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [req-06cec42b-52c1-479a-b36a-92824d9b753f req-9e4549b8-e65f-435d-923b-b8af0f9f91a8 tempest-TestShelveInstance-237177468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.284s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:27:33 devstack cinder-volume[87639]: DEBUG cinder.manager [req-06cec42b-52c1-479a-b36a-92824d9b753f req-9e4549b8-e65f-435d-923b-b8af0f9f91a8 tempest-TestShelveInstance-237177468 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:27:33 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-06cec42b-52c1-479a-b36a-92824d9b753f req-9e4549b8-e65f-435d-923b-b8af0f9f91a8 tempest-TestShelveInstance-237177468 None] Deleted volume successfully. Sep 09 18:27:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [req-06cec42b-52c1-479a-b36a-92824d9b753f req-9e4549b8-e65f-435d-923b-b8af0f9f91a8 tempest-TestShelveInstance-237177468 None] Lock "cinder-7cc6c97c-9b8c-4cc2-9e16-8bef190cb800-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:27:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:27:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:27:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:27:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:27:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:27:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:27:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:27:43 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:27:43 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:27:43 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Sep 09 18:27:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.296s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:27:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:27:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:27:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 29 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:27:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:27:43 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=6 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:27:43 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=7,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Flow 'volume_create_manager' (2bd27dd9-2f5f-415a-af3f-b3b7d5f787dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc90f036-0df5-4fe6-8bdb-cd88c6a02fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc90f036-0df5-4fe6-8bdb-cd88c6a02fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-463688961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c23d7b-4287-4c06-a22d-24c3b9375d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd8b07c560546f99f7f1c6f70068567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:27:54Z,use_quota=True,user_id='f1484761d2504f5995114875f35bd3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ec5214-a02c-46c2-8f73-acc5a81d7712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ec5214-a02c-46c2-8f73-acc5a81d7712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200926b9-32d8-4b23-bb4d-bfe81b6c1b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (200926b9-32d8-4b23-bb4d-bfe81b6c1b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34c23d7b-4287-4c06-a22d-24c3b9375d95', 'volume_name': 'volume-34c23d7b-4287-4c06-a22d-24c3b9375d95', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8183f7e1-7acd-420a-9234-347fb9357d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8183f7e1-7acd-420a-9234-347fb9357d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f1a3560-cb80-4fa7-b925-454554654ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:27:54 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Volume 34c23d7b-4287-4c06-a22d-24c3b9375d95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34c23d7b-4287-4c06-a22d-24c3b9375d95', 'volume_size': 1} Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-463688961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c23d7b-4287-4c06-a22d-24c3b9375d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd8b07c560546f99f7f1c6f70068567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:27:54Z,use_quota=True,user_id='f1484761d2504f5995114875f35bd3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Creating volume 34c23d7b-4287-4c06-a22d-24c3b9375d95 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:27:54 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:27:54 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 1073741824 Sep 09 18:27:54 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:27:54 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 1073741824" returned: 0 in 0.446s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:27:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:27:54 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 Sep 09 18:27:54 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:27:55 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Sep 09 18:27:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95" returned: 0 in 0.245s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:27:55 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:27:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:27:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f1a3560-cb80-4fa7-b925-454554654ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34c23d7b-4287-4c06-a22d-24c3b9375d95', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:27:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11a8c71-85b8-47aa-829f-341158ed3baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:27:55 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Volume volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 (34c23d7b-4287-4c06-a22d-24c3b9375d95): created successfully Sep 09 18:27:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11a8c71-85b8-47aa-829f-341158ed3baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:27:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Flow 'volume_create_manager' (2bd27dd9-2f5f-415a-af3f-b3b7d5f787dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:27:55 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-5edd14ab-9354-4ad1-b661-ce2c8433e419 tempest-TestStampPattern-1361092874 None] Created volume successfully. Sep 09 18:28:05 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:28:05 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:28:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-52537983-ff66-4031-9d89-13ad205919b0 req-63261355-960e-44d5-88c9-0bcc7e83cdba tempest-TestStampPattern-1361092874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:28:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-52537983-ff66-4031-9d89-13ad205919b0 req-63261355-960e-44d5-88c9-0bcc7e83cdba tempest-TestStampPattern-1361092874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:28:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-52537983-ff66-4031-9d89-13ad205919b0 req-63261355-960e-44d5-88c9-0bcc7e83cdba tempest-TestStampPattern-1361092874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:28:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-52537983-ff66-4031-9d89-13ad205919b0 req-63261355-960e-44d5-88c9-0bcc7e83cdba tempest-TestStampPattern-1361092874 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-34c23d7b-4287-4c06-a22d-24c3b9375d95', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9126837c-b9e5-4845-a7c6-7f4fa37bd422', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:28:25 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-52537983-ff66-4031-9d89-13ad205919b0 req-63261355-960e-44d5-88c9-0bcc7e83cdba tempest-TestStampPattern-1361092874 None] attachment_update completed successfully. Sep 09 18:28:28 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-d564d16d-d828-43ae-974d-4f7093b4dc88 req-ecf41744-6950-40b8-ac96-328499fef0ff tempest-TestStampPattern-1361092874 None] Terminate volume connection completed successfully. Sep 09 18:28:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-d564d16d-d828-43ae-974d-4f7093b4dc88 req-ecf41744-6950-40b8-ac96-328499fef0ff tempest-TestStampPattern-1361092874 None] Deleting attachment 9126837c-b9e5-4845-a7c6-7f4fa37bd422. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:28:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-010cbdd8-bd57-4b16-82ab-003bf99bcd03 tempest-TestStampPattern-1361092874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:28:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-010cbdd8-bd57-4b16-82ab-003bf99bcd03 tempest-TestStampPattern-1361092874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:28:29 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-010cbdd8-bd57-4b16-82ab-003bf99bcd03 tempest-TestStampPattern-1361092874 None] Creating offline snapshot 748b23b9-966b-415f-8b87-e323a8c46944 of volume 34c23d7b-4287-4c06-a22d-24c3b9375d95 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:28:29 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8234f7a5-b3cb-4f05-b0d7-d57c42451c27]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:28:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-010cbdd8-bd57-4b16-82ab-003bf99bcd03 tempest-TestStampPattern-1361092874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:28:29 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 Sep 09 18:28:29 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:28:30 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Sep 09 18:28:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-010cbdd8-bd57-4b16-82ab-003bf99bcd03 tempest-TestStampPattern-1361092874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95" returned: 0 in 0.353s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:28:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-010cbdd8-bd57-4b16-82ab-003bf99bcd03 tempest-TestStampPattern-1361092874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:28:30 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944 1G Sep 09 18:28:30 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:28:30 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Sep 09 18:28:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-010cbdd8-bd57-4b16-82ab-003bf99bcd03 tempest-TestStampPattern-1361092874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944 1G" returned: 0 in 0.369s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:28:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-010cbdd8-bd57-4b16-82ab-003bf99bcd03 tempest-TestStampPattern-1361092874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:28:30 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944 Sep 09 18:28:30 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:28:30 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Sep 09 18:28:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-010cbdd8-bd57-4b16-82ab-003bf99bcd03 tempest-TestStampPattern-1361092874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944" returned: 0 in 0.292s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:28:30 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-010cbdd8-bd57-4b16-82ab-003bf99bcd03 tempest-TestStampPattern-1361092874 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944 is being set with open permissions: ugo+rw Sep 09 18:28:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-010cbdd8-bd57-4b16-82ab-003bf99bcd03 tempest-TestStampPattern-1361092874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:28:30 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944 Sep 09 18:28:30 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:28:31 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Sep 09 18:28:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-010cbdd8-bd57-4b16-82ab-003bf99bcd03 tempest-TestStampPattern-1361092874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944" returned: 0 in 0.238s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:28:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-010cbdd8-bd57-4b16-82ab-003bf99bcd03 tempest-TestStampPattern-1361092874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:28:31 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.info Sep 09 18:28:31 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:28:31 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Sep 09 18:28:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-010cbdd8-bd57-4b16-82ab-003bf99bcd03 tempest-TestStampPattern-1361092874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.info" returned: 0 in 0.256s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:28:31 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-010cbdd8-bd57-4b16-82ab-003bf99bcd03 tempest-TestStampPattern-1361092874 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.info is being set with open permissions: ugo+rw Sep 09 18:28:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-010cbdd8-bd57-4b16-82ab-003bf99bcd03 tempest-TestStampPattern-1361092874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:28:31 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.info Sep 09 18:28:31 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:28:31 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 09 18:28:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-010cbdd8-bd57-4b16-82ab-003bf99bcd03 tempest-TestStampPattern-1361092874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.info" returned: 0 in 0.245s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:28:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-010cbdd8-bd57-4b16-82ab-003bf99bcd03 tempest-TestStampPattern-1361092874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.829s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:28:31 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-010cbdd8-bd57-4b16-82ab-003bf99bcd03 tempest-TestStampPattern-1361092874 None] Create snapshot completed successfully Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Flow 'volume_create_manager' (b91e8130-cf66-4cd6-9f41-df9c3f279e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1c9b64-90ac-43d9-89a8-69bb05b1d11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1c9b64-90ac-43d9-89a8-69bb05b1d11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1994002507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d73761-191f-4bcc-8cac-e60c45e8d9e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd8b07c560546f99f7f1c6f70068567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=748b23b9-966b-415f-8b87-e323a8c46944,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:28:39Z,use_quota=True,user_id='f1484761d2504f5995114875f35bd3c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02980ac9-47ea-42b7-9936-318f7f01e0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02980ac9-47ea-42b7-9936-318f7f01e0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ada7d6b-ad59-46b0-9b45-3d0690490a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ada7d6b-ad59-46b0-9b45-3d0690490a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '75d73761-191f-4bcc-8cac-e60c45e8d9e1', 'volume_name': 'volume-75d73761-191f-4bcc-8cac-e60c45e8d9e1', 'volume_size': 1, 'snapshot_id': '748b23b9-966b-415f-8b87-e323a8c46944'}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259d6cd3-0986-4993-9981-6495100f935e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (259d6cd3-0986-4993-9981-6495100f935e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c05ca7d-6d5c-4bd6-b412-0e97045f2003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:28:39 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Volume 75d73761-191f-4bcc-8cac-e60c45e8d9e1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-75d73761-191f-4bcc-8cac-e60c45e8d9e1', 'volume_size': 1, 'snapshot_id': '748b23b9-966b-415f-8b87-e323a8c46944'} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Acquiring lock "cinder-quobyte-748b23b9-966b-415f-8b87-e323a8c46944-75d73761-191f-4bcc-8cac-e60c45e8d9e1" by "_create_volume_from_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Lock "cinder-quobyte-748b23b9-966b-415f-8b87-e323a8c46944-75d73761-191f-4bcc-8cac-e60c45e8d9e1" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Creating volume 75d73761-191f-4bcc-8cac-e60c45e8d9e1 from snapshot 748b23b9-966b-415f-8b87-e323a8c46944 {{(pid=87639) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Acquiring lock "cinder-quobyte-75d73761-191f-4bcc-8cac-e60c45e8d9e1" by "_copy_volume_from_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Lock "cinder-quobyte-75d73761-191f-4bcc-8cac-e60c45e8d9e1" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] snapshot: 748b23b9-966b-415f-8b87-e323a8c46944, volume: 75d73761-191f-4bcc-8cac-e60c45e8d9e1, {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a7f841-f3c3-4fea-bd70-cb2368371bf8]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:28:39 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944 Sep 09 18:28:39 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:28:39 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944" returned: 0 in 0.361s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34c23d7b-4287-4c06-a22d-24c3b9375d95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca822b51-9047-41da-af63-6cbdc277abbb]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:28:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:28:39 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 Sep 09 18:28:39 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:28:40 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Sep 09 18:28:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95" returned: 0 in 0.390s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:28:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 18:28:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Creating direct copy from snapshot {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 18:28:40 devstack cinder-volume[87639]: DEBUG cinder.utils [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Path /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75d73761-191f-4bcc-8cac-e60c45e8d9e1 not found in is_blk_device check {{(pid=87639) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 18:28:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75d73761-191f-4bcc-8cac-e60c45e8d9e1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:28:40 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75d73761-191f-4bcc-8cac-e60c45e8d9e1 Sep 09 18:28:40 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:28:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:28:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:28:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:28:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:28:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:28:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:28:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:28:43 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:28:43 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:28:44 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Sep 09 18:28:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.820s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:28:44 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:28:44 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:28:44 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 29 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:28:44 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:28:45 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Sep 09 18:28:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75d73761-191f-4bcc-8cac-e60c45e8d9e1" returned: 0 in 5.726s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:28:45 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Image conversion details: src /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75d73761-191f-4bcc-8cac-e60c45e8d9e1 {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:28:45 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Converted 1024.00 MB image at 178.79 MB/s Sep 09 18:28:45 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75d73761-191f-4bcc-8cac-e60c45e8d9e1 is being set with open permissions: ugo+rw Sep 09 18:28:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75d73761-191f-4bcc-8cac-e60c45e8d9e1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:28:45 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75d73761-191f-4bcc-8cac-e60c45e8d9e1 Sep 09 18:28:45 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:28:46 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Sep 09 18:28:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75d73761-191f-4bcc-8cac-e60c45e8d9e1" returned: 0 in 0.290s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:28:46 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Lock "cinder-quobyte-75d73761-191f-4bcc-8cac-e60c45e8d9e1" released by "_copy_volume_from_snapshot" :: held 6.852s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:28:46 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Lock "cinder-quobyte-748b23b9-966b-415f-8b87-e323a8c46944-75d73761-191f-4bcc-8cac-e60c45e8d9e1" released by "_create_volume_from_snapshot" :: held 6.924s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:28:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.940s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:28:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c05ca7d-6d5c-4bd6-b412-0e97045f2003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d73761-191f-4bcc-8cac-e60c45e8d9e1', 'volume_size': 1, 'snapshot_id': '748b23b9-966b-415f-8b87-e323a8c46944'}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:28:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337b5635-8038-4a30-8857-1fbd821fe05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:28:46 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Volume volume-75d73761-191f-4bcc-8cac-e60c45e8d9e1 (75d73761-191f-4bcc-8cac-e60c45e8d9e1): created successfully Sep 09 18:28:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337b5635-8038-4a30-8857-1fbd821fe05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:28:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Flow 'volume_create_manager' (b91e8130-cf66-4cd6-9f41-df9c3f279e0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:28:46 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-464c508c-b4a7-40fb-bc06-0032317a220d tempest-TestStampPattern-1361092874 None] Created volume successfully. Sep 09 18:28:56 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:UPDATE=5,cinder:SELECT=16,cinder:INSERT=2 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:28:56 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=14,cinder:UPDATE=8,cinder:DELETE=2 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:29:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-32a09f2e-2031-4a12-99ee-fef272ddfe47 req-fd43b6b6-14a1-4b4a-bcdf-45b59f61e4bd tempest-TestStampPattern-1361092874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:29:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-32a09f2e-2031-4a12-99ee-fef272ddfe47 req-fd43b6b6-14a1-4b4a-bcdf-45b59f61e4bd tempest-TestStampPattern-1361092874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:29:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [req-32a09f2e-2031-4a12-99ee-fef272ddfe47 req-fd43b6b6-14a1-4b4a-bcdf-45b59f61e4bd tempest-TestStampPattern-1361092874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:29:28 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-32a09f2e-2031-4a12-99ee-fef272ddfe47 req-fd43b6b6-14a1-4b4a-bcdf-45b59f61e4bd tempest-TestStampPattern-1361092874 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f', 'name': 'volume-75d73761-191f-4bcc-8cac-e60c45e8d9e1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5440612-fb7e-4dd5-b209-df9f83bc059c', 'enforce_multipath': True} {{(pid=87639) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 18:29:28 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-32a09f2e-2031-4a12-99ee-fef272ddfe47 req-fd43b6b6-14a1-4b4a-bcdf-45b59f61e4bd tempest-TestStampPattern-1361092874 None] attachment_update completed successfully. Sep 09 18:29:31 devstack cinder-volume[87639]: INFO cinder.volume.manager [req-03214ef2-fedb-4e98-9e52-561b2bb156d6 req-56f0cd74-5f7f-4db1-9024-7685ecef5fd3 tempest-TestStampPattern-1361092874 None] Terminate volume connection completed successfully. Sep 09 18:29:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [req-03214ef2-fedb-4e98-9e52-561b2bb156d6 req-56f0cd74-5f7f-4db1-9024-7685ecef5fd3 tempest-TestStampPattern-1361092874 None] Deleting attachment c5440612-fb7e-4dd5-b209-df9f83bc059c. {{(pid=87639) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 18:29:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c63bbd3c-c1b1-4c9b-ad0e-f2704f50879f tempest-TestStampPattern-1361092874 None] Acquiring lock "cinder-75d73761-191f-4bcc-8cac-e60c45e8d9e1-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:29:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c63bbd3c-c1b1-4c9b-ad0e-f2704f50879f tempest-TestStampPattern-1361092874 None] Lock "cinder-75d73761-191f-4bcc-8cac-e60c45e8d9e1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:29:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c63bbd3c-c1b1-4c9b-ad0e-f2704f50879f tempest-TestStampPattern-1361092874 None] Acquiring lock "cinder-quobyte-75d73761-191f-4bcc-8cac-e60c45e8d9e1" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:29:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c63bbd3c-c1b1-4c9b-ad0e-f2704f50879f tempest-TestStampPattern-1361092874 None] Lock "cinder-quobyte-75d73761-191f-4bcc-8cac-e60c45e8d9e1" acquired by "delete_volume" :: waited 0.015s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:29:35 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbe6c78-7a8d-4238-8f34-8cf5361cf8ed]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:29:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c63bbd3c-c1b1-4c9b-ad0e-f2704f50879f tempest-TestStampPattern-1361092874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75d73761-191f-4bcc-8cac-e60c45e8d9e1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:29:35 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75d73761-191f-4bcc-8cac-e60c45e8d9e1 Sep 09 18:29:35 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:29:35 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Sep 09 18:29:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c63bbd3c-c1b1-4c9b-ad0e-f2704f50879f tempest-TestStampPattern-1361092874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75d73761-191f-4bcc-8cac-e60c45e8d9e1" returned: 0 in 0.369s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:29:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c63bbd3c-c1b1-4c9b-ad0e-f2704f50879f tempest-TestStampPattern-1361092874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75d73761-191f-4bcc-8cac-e60c45e8d9e1 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:29:35 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75d73761-191f-4bcc-8cac-e60c45e8d9e1 Sep 09 18:29:35 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:29:35 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Sep 09 18:29:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c63bbd3c-c1b1-4c9b-ad0e-f2704f50879f tempest-TestStampPattern-1361092874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75d73761-191f-4bcc-8cac-e60c45e8d9e1" returned: 0 in 0.239s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:29:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c63bbd3c-c1b1-4c9b-ad0e-f2704f50879f tempest-TestStampPattern-1361092874 None] Lock "cinder-quobyte-75d73761-191f-4bcc-8cac-e60c45e8d9e1" released by "delete_volume" :: held 0.643s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:29:35 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-c63bbd3c-c1b1-4c9b-ad0e-f2704f50879f tempest-TestStampPattern-1361092874 None] Created reservations ['10409cac-12ec-40a4-9f76-322c5f89a94c', '757df61e-3f30-40d0-a3b9-ee7af08ccfa3', '51f18d62-efac-4154-988b-12d4b9c67345', 'dd83a5e2-0eae-4ccb-96a0-81f164ce9bb6'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:29:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c63bbd3c-c1b1-4c9b-ad0e-f2704f50879f tempest-TestStampPattern-1361092874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:29:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c63bbd3c-c1b1-4c9b-ad0e-f2704f50879f tempest-TestStampPattern-1361092874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:29:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c63bbd3c-c1b1-4c9b-ad0e-f2704f50879f tempest-TestStampPattern-1361092874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:29:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c63bbd3c-c1b1-4c9b-ad0e-f2704f50879f tempest-TestStampPattern-1361092874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:29:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c63bbd3c-c1b1-4c9b-ad0e-f2704f50879f tempest-TestStampPattern-1361092874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:29:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c63bbd3c-c1b1-4c9b-ad0e-f2704f50879f tempest-TestStampPattern-1361092874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:29:35 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:29:35 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:29:36 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Sep 09 18:29:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c63bbd3c-c1b1-4c9b-ad0e-f2704f50879f tempest-TestStampPattern-1361092874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.252s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:29:36 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-c63bbd3c-c1b1-4c9b-ad0e-f2704f50879f tempest-TestStampPattern-1361092874 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:29:36 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-c63bbd3c-c1b1-4c9b-ad0e-f2704f50879f tempest-TestStampPattern-1361092874 None] Deleted volume successfully. Sep 09 18:29:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c63bbd3c-c1b1-4c9b-ad0e-f2704f50879f tempest-TestStampPattern-1361092874 None] Lock "cinder-75d73761-191f-4bcc-8cac-e60c45e8d9e1-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:29:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9f6206e5-7aac-439a-98b5-33accc63af3e tempest-TestStampPattern-1361092874 None] Acquiring lock "cinder-748b23b9-966b-415f-8b87-e323a8c46944-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:29:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9f6206e5-7aac-439a-98b5-33accc63af3e tempest-TestStampPattern-1361092874 None] Lock "cinder-748b23b9-966b-415f-8b87-e323a8c46944-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:29:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9f6206e5-7aac-439a-98b5-33accc63af3e tempest-TestStampPattern-1361092874 None] Acquiring lock "cinder-quobyte-34c23d7b-4287-4c06-a22d-24c3b9375d95" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:29:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9f6206e5-7aac-439a-98b5-33accc63af3e tempest-TestStampPattern-1361092874 None] Lock "cinder-quobyte-34c23d7b-4287-4c06-a22d-24c3b9375d95" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:29:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9f6206e5-7aac-439a-98b5-33accc63af3e tempest-TestStampPattern-1361092874 None] Acquiring lock "cinder-quobyte-748b23b9-966b-415f-8b87-e323a8c46944" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:29:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9f6206e5-7aac-439a-98b5-33accc63af3e tempest-TestStampPattern-1361092874 None] Lock "cinder-quobyte-748b23b9-966b-415f-8b87-e323a8c46944" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:29:36 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-9f6206e5-7aac-439a-98b5-33accc63af3e tempest-TestStampPattern-1361092874 None] Deleting offline snapshot 748b23b9-966b-415f-8b87-e323a8c46944 of volume 34c23d7b-4287-4c06-a22d-24c3b9375d95 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:29:36 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-9f6206e5-7aac-439a-98b5-33accc63af3e tempest-TestStampPattern-1361092874 None] snapshot_file for this snap is: volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:29:36 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[28325d70-78ad-46fa-9f75-946e5ca78f43]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:29:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9f6206e5-7aac-439a-98b5-33accc63af3e tempest-TestStampPattern-1361092874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:29:36 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944 Sep 09 18:29:36 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:29:36 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Sep 09 18:29:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9f6206e5-7aac-439a-98b5-33accc63af3e tempest-TestStampPattern-1361092874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944" returned: 0 in 0.340s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:29:36 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-9f6206e5-7aac-439a-98b5-33accc63af3e tempest-TestStampPattern-1361092874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34c23d7b-4287-4c06-a22d-24c3b9375d95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:29:36 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0099e6-1df0-4740-bae9-c78de33f7389]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:29:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9f6206e5-7aac-439a-98b5-33accc63af3e tempest-TestStampPattern-1361092874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:29:37 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 Sep 09 18:29:37 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:29:37 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 09 18:29:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9f6206e5-7aac-439a-98b5-33accc63af3e tempest-TestStampPattern-1361092874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95" returned: 0 in 0.498s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:29:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9f6206e5-7aac-439a-98b5-33accc63af3e tempest-TestStampPattern-1361092874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:29:37 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944 Sep 09 18:29:37 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:29:37 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Sep 09 18:29:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9f6206e5-7aac-439a-98b5-33accc63af3e tempest-TestStampPattern-1361092874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944" returned: 0 in 0.321s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:29:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9f6206e5-7aac-439a-98b5-33accc63af3e tempest-TestStampPattern-1361092874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:29:37 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944 Sep 09 18:29:37 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:29:37 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 09 18:29:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9f6206e5-7aac-439a-98b5-33accc63af3e tempest-TestStampPattern-1361092874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95.748b23b9-966b-415f-8b87-e323a8c46944" returned: 0 in 0.244s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:29:38 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9f6206e5-7aac-439a-98b5-33accc63af3e tempest-TestStampPattern-1361092874 None] Lock "cinder-quobyte-748b23b9-966b-415f-8b87-e323a8c46944" released by "_delete_snapshot" :: held 1.497s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:29:38 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9f6206e5-7aac-439a-98b5-33accc63af3e tempest-TestStampPattern-1361092874 None] Lock "cinder-quobyte-34c23d7b-4287-4c06-a22d-24c3b9375d95" released by "delete_snapshot" :: held 1.521s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:29:38 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-9f6206e5-7aac-439a-98b5-33accc63af3e tempest-TestStampPattern-1361092874 None] Created reservations ['64ecccd4-682b-43d8-8082-251ab7442f2d', '130f981d-f80c-45ee-bd26-4b14fa2d0557', '8f9c99ee-8268-420b-b6e5-053b2562c568', '6b6a1b17-3e77-4f4e-91d5-285c00bc3bd9'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:29:38 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-9f6206e5-7aac-439a-98b5-33accc63af3e tempest-TestStampPattern-1361092874 None] Delete snapshot completed successfully. Sep 09 18:29:38 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9f6206e5-7aac-439a-98b5-33accc63af3e tempest-TestStampPattern-1361092874 None] Lock "cinder-748b23b9-966b-415f-8b87-e323a8c46944-delete_snapshot" released by "delete_snapshot" :: held 1.647s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:29:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f99361cf-dd87-44dd-a40a-792f6773424e tempest-TestStampPattern-1361092874 None] Acquiring lock "cinder-34c23d7b-4287-4c06-a22d-24c3b9375d95-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:29:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f99361cf-dd87-44dd-a40a-792f6773424e tempest-TestStampPattern-1361092874 None] Lock "cinder-34c23d7b-4287-4c06-a22d-24c3b9375d95-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:29:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f99361cf-dd87-44dd-a40a-792f6773424e tempest-TestStampPattern-1361092874 None] Acquiring lock "cinder-quobyte-34c23d7b-4287-4c06-a22d-24c3b9375d95" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:29:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f99361cf-dd87-44dd-a40a-792f6773424e tempest-TestStampPattern-1361092874 None] Lock "cinder-quobyte-34c23d7b-4287-4c06-a22d-24c3b9375d95" acquired by "delete_volume" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:29:42 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4567007c-bd76-43de-8218-cddf7588484f]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:29:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f99361cf-dd87-44dd-a40a-792f6773424e tempest-TestStampPattern-1361092874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:29:42 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 Sep 09 18:29:42 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:29:42 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Sep 09 18:29:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f99361cf-dd87-44dd-a40a-792f6773424e tempest-TestStampPattern-1361092874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95" returned: 0 in 0.354s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:29:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f99361cf-dd87-44dd-a40a-792f6773424e tempest-TestStampPattern-1361092874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:29:42 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95 Sep 09 18:29:42 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:29:42 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Sep 09 18:29:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f99361cf-dd87-44dd-a40a-792f6773424e tempest-TestStampPattern-1361092874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-34c23d7b-4287-4c06-a22d-24c3b9375d95" returned: 0 in 0.247s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:29:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f99361cf-dd87-44dd-a40a-792f6773424e tempest-TestStampPattern-1361092874 None] Lock "cinder-quobyte-34c23d7b-4287-4c06-a22d-24c3b9375d95" released by "delete_volume" :: held 0.656s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:29:42 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-f99361cf-dd87-44dd-a40a-792f6773424e tempest-TestStampPattern-1361092874 None] Created reservations ['8dc78226-1e24-4dc1-ac9e-968289da7be5', '3f2fd6d3-6968-4440-830a-5ffa85039734', '9b75ac47-09c0-4c0a-a222-92425cb33660', '933789e1-d1ee-495f-b378-acb7f9393706'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:29:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f99361cf-dd87-44dd-a40a-792f6773424e tempest-TestStampPattern-1361092874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:29:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f99361cf-dd87-44dd-a40a-792f6773424e tempest-TestStampPattern-1361092874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:29:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f99361cf-dd87-44dd-a40a-792f6773424e tempest-TestStampPattern-1361092874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:29:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f99361cf-dd87-44dd-a40a-792f6773424e tempest-TestStampPattern-1361092874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:29:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f99361cf-dd87-44dd-a40a-792f6773424e tempest-TestStampPattern-1361092874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:29:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f99361cf-dd87-44dd-a40a-792f6773424e tempest-TestStampPattern-1361092874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:29:42 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:29:42 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:29:43 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Sep 09 18:29:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f99361cf-dd87-44dd-a40a-792f6773424e tempest-TestStampPattern-1361092874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.245s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:29:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-f99361cf-dd87-44dd-a40a-792f6773424e tempest-TestStampPattern-1361092874 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:29:43 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-f99361cf-dd87-44dd-a40a-792f6773424e tempest-TestStampPattern-1361092874 None] Deleted volume successfully. Sep 09 18:29:43 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f99361cf-dd87-44dd-a40a-792f6773424e tempest-TestStampPattern-1361092874 None] Lock "cinder-34c23d7b-4287-4c06-a22d-24c3b9375d95-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:29:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:29:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:29:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:29:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:29:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:29:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:29:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:29:43 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:29:43 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:29:43 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Sep 09 18:29:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.251s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:29:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:29:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:29:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 29 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:29:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:29:52 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=26,cinder:UPDATE=22,cinder:INSERT=6 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:29:53 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=20,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:29:56 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:29:56 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Flow 'volume_create_manager' (a83c8e07-d830-42c8-b2a6-839450ee6b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:29:56 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ef5140-2301-438d-97ca-a3455795706b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:29:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39ef5140-2301-438d-97ca-a3455795706b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28af96a-ec6d-415b-8a75-ead17106c933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb090d8416434d02ac70b02242a2632f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:29:57Z,use_quota=True,user_id='6efa0aa35d0645a4ac41567240f50d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b82bc34-8072-4192-a602-e5ed8f01bb4c),volume_type_id=5b82bc34-8072-4192-a602-e5ed8f01bb4c)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:29:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eefa197a-b39b-4b60-b716-71a1278609f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:29:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eefa197a-b39b-4b60-b716-71a1278609f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:29:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51987b0d-c887-4b46-9fe6-dfbe596a0add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:29:57 devstack cinder-volume[87639]: DEBUG cinder.image.glance [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Creating Keystone auth plugin from conf {{(pid=87639) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 18:29:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51987b0d-c887-4b46-9fe6-dfbe596a0add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a28af96a-ec6d-415b-8a75-ead17106c933', 'volume_name': 'volume-a28af96a-ec6d-415b-8a75-ead17106c933', 'volume_size': 1, 'image_id': 'fa37e965-46ac-477b-8cd4-1cf7215edb93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa37e965-46ac-477b-8cd4-1cf7215edb93', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c20d854dec07c4d386e04e95488e788', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cb090d8416434d02ac70b02242a2632f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8731f83788f909e9ab4318994d410b7005b7dc1ff297c7cd39b9817f17a906b5605f8ae398b512de1753988f7a31f15cf0eaa4786e15109df195f3498150c479', 'id': 'fa37e965-46ac-477b-8cd4-1cf7215edb93', 'created_at': datetime.datetime(2026, 9, 9, 16, 29, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 29, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa37e965-46ac-477b-8cd4-1cf7215edb93/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:29:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec43fc2-1967-4a25-9127-ef2e77bfbef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:29:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec43fc2-1967-4a25-9127-ef2e77bfbef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:29:57 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (044085ac-27fe-4d9c-b22e-f5de7cae4997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:29:57 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Volume a28af96a-ec6d-415b-8a75-ead17106c933: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a28af96a-ec6d-415b-8a75-ead17106c933', 'volume_size': 1, 'image_id': 'fa37e965-46ac-477b-8cd4-1cf7215edb93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa37e965-46ac-477b-8cd4-1cf7215edb93', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c20d854dec07c4d386e04e95488e788', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cb090d8416434d02ac70b02242a2632f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8731f83788f909e9ab4318994d410b7005b7dc1ff297c7cd39b9817f17a906b5605f8ae398b512de1753988f7a31f15cf0eaa4786e15109df195f3498150c479', 'id': 'fa37e965-46ac-477b-8cd4-1cf7215edb93', 'created_at': datetime.datetime(2026, 9, 9, 16, 29, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 29, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa37e965-46ac-477b-8cd4-1cf7215edb93/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 09 18:29:57 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Trying to clone a28af96a-ec6d-415b-8a75-ead17106c933 from image fa37e965-46ac-477b-8cd4-1cf7215edb93 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fa37e965-46ac-477b-8cd4-1cf7215edb93', 'metadata': {}}]). {{(pid=87639) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 18:29:57 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 18:29:57 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Image download 0.00 MB at 0.00 MB/s Sep 09 18:29:57 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[516945c3-73af-496b-b4d3-8ba2a7f8579d]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:29:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:29:57 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD Sep 09 18:29:57 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:29:57 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Sep 09 18:29:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:29:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:29:57 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD Sep 09 18:29:57 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:29:58 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Sep 09 18:29:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD" returned: 1 in 0.322s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:29:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:29:58 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Temporary image fa37e965-46ac-477b-8cd4-1cf7215edb93 is fetched for user 6efa0aa35d0645a4ac41567240f50d9e. {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 18:29:58 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fe5e68-acbc-4da3-9d95-7bd1888faedb]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:29:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:29:58 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD Sep 09 18:29:58 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:29:58 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 09 18:29:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD" returned: 0 in 0.309s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:29:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:29:58 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD Sep 09 18:29:58 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:29:58 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Sep 09 18:29:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD" returned: 1 in 0.312s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:29:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:29:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:29:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:29:58 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28af96a-ec6d-415b-8a75-ead17106c933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb090d8416434d02ac70b02242a2632f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:29:57Z,use_quota=True,user_id='6efa0aa35d0645a4ac41567240f50d9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b82bc34-8072-4192-a602-e5ed8f01bb4c),volume_type_id=5b82bc34-8072-4192-a602-e5ed8f01bb4c)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:29:58 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Creating volume a28af96a-ec6d-415b-8a75-ead17106c933 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:29:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:29:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:29:58 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:29:58 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:29:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:29:58 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:29:58 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:29:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a28af96a-ec6d-415b-8a75-ead17106c933 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:29:58 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a28af96a-ec6d-415b-8a75-ead17106c933 1073741824 Sep 09 18:29:58 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:29:59 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 09 18:29:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a28af96a-ec6d-415b-8a75-ead17106c933 1073741824" returned: 0 in 0.421s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:29:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a28af96a-ec6d-415b-8a75-ead17106c933 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:29:59 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a28af96a-ec6d-415b-8a75-ead17106c933 Sep 09 18:29:59 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:29:59 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 09 18:29:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a28af96a-ec6d-415b-8a75-ead17106c933" returned: 0 in 0.240s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:29:59 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:29:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:29:59 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Attempting download of fa37e965-46ac-477b-8cd4-1cf7215edb93 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa37e965-46ac-477b-8cd4-1cf7215edb93', 'metadata': {}}])) to volume a28af96a-ec6d-415b-8a75-ead17106c933. {{(pid=87639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 18:29:59 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[66206d82-f949-4a27-a12e-b60d32a57c33]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:29:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa37e965-46ac-477b-8cd4-1cf7215edb93_m0h5gf6k {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:29:59 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa37e965-46ac-477b-8cd4-1cf7215edb93_m0h5gf6k Sep 09 18:29:59 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:29:59 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Sep 09 18:29:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa37e965-46ac-477b-8cd4-1cf7215edb93_m0h5gf6k" returned: 0 in 0.330s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:29:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa37e965-46ac-477b-8cd4-1cf7215edb93_m0h5gf6k {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:29:59 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa37e965-46ac-477b-8cd4-1cf7215edb93_m0h5gf6k Sep 09 18:29:59 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:00 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa37e965-46ac-477b-8cd4-1cf7215edb93_m0h5gf6k" returned: 1 in 0.323s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa37e965-46ac-477b-8cd4-1cf7215edb93_m0h5gf6k' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:30:00 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d232be7-01f0-4ee7-ada9-0bcaaff4ae5b]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:30:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:00 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD Sep 09 18:30:00 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:00 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:00 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD Sep 09 18:30:00 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:00 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD" returned: 1 in 0.318s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:30:00 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] fa37e965-46ac-477b-8cd4-1cf7215edb93 was raw, converting to qcow2 {{(pid=87639) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 18:30:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a28af96a-ec6d-415b-8a75-ead17106c933 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:00 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a28af96a-ec6d-415b-8a75-ead17106c933 Sep 09 18:30:00 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:01 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a28af96a-ec6d-415b-8a75-ead17106c933" returned: 0 in 0.435s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:01 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fa37e965-46ac-477b-8cd4-1cf7215edb93_2aov2gvcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a28af96a-ec6d-415b-8a75-ead17106c933 {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:30:01 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Converted 0.00 MB image at 0.00 MB/s Sep 09 18:30:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a28af96a-ec6d-415b-8a75-ead17106c933 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:01 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a28af96a-ec6d-415b-8a75-ead17106c933 1G Sep 09 18:30:01 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:01 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a28af96a-ec6d-415b-8a75-ead17106c933 1G" returned: 0 in 0.302s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:01 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Downloaded image fa37e965-46ac-477b-8cd4-1cf7215edb93 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa37e965-46ac-477b-8cd4-1cf7215edb93', 'metadata': {}}])) to volume a28af96a-ec6d-415b-8a75-ead17106c933 successfully. {{(pid=87639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 18:30:01 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Temporary image fa37e965-46ac-477b-8cd4-1cf7215edb93 for user 6efa0aa35d0645a4ac41567240f50d9e is deleted. {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 18:30:01 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Marking volume a28af96a-ec6d-415b-8a75-ead17106c933 as bootable. {{(pid=87639) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 18:30:01 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Copying metadata from image fa37e965-46ac-477b-8cd4-1cf7215edb93 to a28af96a-ec6d-415b-8a75-ead17106c933. {{(pid=87639) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 18:30:01 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Creating volume glance metadata for volume a28af96a-ec6d-415b-8a75-ead17106c933 backed by image fa37e965-46ac-477b-8cd4-1cf7215edb93 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'fa37e965-46ac-477b-8cd4-1cf7215edb93', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2c20d854dec07c4d386e04e95488e788', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87639) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 18:30:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (044085ac-27fe-4d9c-b22e-f5de7cae4997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a28af96a-ec6d-415b-8a75-ead17106c933', 'volume_size': 1, 'image_id': 'fa37e965-46ac-477b-8cd4-1cf7215edb93', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa37e965-46ac-477b-8cd4-1cf7215edb93', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2c20d854dec07c4d386e04e95488e788', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cb090d8416434d02ac70b02242a2632f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8731f83788f909e9ab4318994d410b7005b7dc1ff297c7cd39b9817f17a906b5605f8ae398b512de1753988f7a31f15cf0eaa4786e15109df195f3498150c479', 'id': 'fa37e965-46ac-477b-8cd4-1cf7215edb93', 'created_at': datetime.datetime(2026, 9, 9, 16, 29, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 29, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa37e965-46ac-477b-8cd4-1cf7215edb93/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b256dd4f-2c00-4c2d-9869-2abff0dcafff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:01 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Volume volume-a28af96a-ec6d-415b-8a75-ead17106c933 (a28af96a-ec6d-415b-8a75-ead17106c933): created successfully Sep 09 18:30:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b256dd4f-2c00-4c2d-9869-2abff0dcafff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Flow 'volume_create_manager' (a83c8e07-d830-42c8-b2a6-839450ee6b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:01 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-c459f778-592c-4d4b-9ae3-c61af0dcf0ae tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Created volume successfully. Sep 09 18:30:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8bb1ff33-6036-4012-9b2b-37274cb20ad6 tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Acquiring lock "cinder-a28af96a-ec6d-415b-8a75-ead17106c933-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8bb1ff33-6036-4012-9b2b-37274cb20ad6 tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Lock "cinder-a28af96a-ec6d-415b-8a75-ead17106c933-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8bb1ff33-6036-4012-9b2b-37274cb20ad6 tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Acquiring lock "cinder-quobyte-a28af96a-ec6d-415b-8a75-ead17106c933" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8bb1ff33-6036-4012-9b2b-37274cb20ad6 tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Lock "cinder-quobyte-a28af96a-ec6d-415b-8a75-ead17106c933" acquired by "delete_volume" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:02 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3c4ec2-0fef-432d-95bf-af5b8d271ddd]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:30:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8bb1ff33-6036-4012-9b2b-37274cb20ad6 tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a28af96a-ec6d-415b-8a75-ead17106c933 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:02 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a28af96a-ec6d-415b-8a75-ead17106c933 Sep 09 18:30:02 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:02 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8bb1ff33-6036-4012-9b2b-37274cb20ad6 tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a28af96a-ec6d-415b-8a75-ead17106c933" returned: 0 in 0.347s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8bb1ff33-6036-4012-9b2b-37274cb20ad6 tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a28af96a-ec6d-415b-8a75-ead17106c933 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:02 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a28af96a-ec6d-415b-8a75-ead17106c933 Sep 09 18:30:02 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:02 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8bb1ff33-6036-4012-9b2b-37274cb20ad6 tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a28af96a-ec6d-415b-8a75-ead17106c933" returned: 0 in 0.238s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8bb1ff33-6036-4012-9b2b-37274cb20ad6 tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Lock "cinder-quobyte-a28af96a-ec6d-415b-8a75-ead17106c933" released by "delete_volume" :: held 0.624s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:02 devstack cinder-volume[87639]: WARNING cinder.quota [None req-8bb1ff33-6036-4012-9b2b-37274cb20ad6 tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:30:02 devstack cinder-volume[87639]: WARNING cinder.quota [None req-8bb1ff33-6036-4012-9b2b-37274cb20ad6 tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 09 18:30:02 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-8bb1ff33-6036-4012-9b2b-37274cb20ad6 tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Created reservations ['fb499ba3-70d5-4fb8-a66c-99af227cfd17', 'fdc9c42b-3b51-45c1-879c-0a9f6262642e', 'cc681365-9700-46f7-8ce0-0608e4391808', 'cbb76809-be18-427b-ae99-83dba9897f20'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:30:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8bb1ff33-6036-4012-9b2b-37274cb20ad6 tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8bb1ff33-6036-4012-9b2b-37274cb20ad6 tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8bb1ff33-6036-4012-9b2b-37274cb20ad6 tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8bb1ff33-6036-4012-9b2b-37274cb20ad6 tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8bb1ff33-6036-4012-9b2b-37274cb20ad6 tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8bb1ff33-6036-4012-9b2b-37274cb20ad6 tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:03 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:30:03 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:03 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8bb1ff33-6036-4012-9b2b-37274cb20ad6 tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.240s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:03 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-8bb1ff33-6036-4012-9b2b-37274cb20ad6 tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:30:03 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-8bb1ff33-6036-4012-9b2b-37274cb20ad6 tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Deleted volume successfully. Sep 09 18:30:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8bb1ff33-6036-4012-9b2b-37274cb20ad6 tempest-VolumeAndVolumeTypeFromImageTest-894388169 None] Lock "cinder-a28af96a-ec6d-415b-8a75-ead17106c933-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Flow 'volume_create_manager' (70baba82-37b3-469b-ad22-a3f6d819e320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fbb8c6-a657-420c-9608-4a6a49d25bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fbb8c6-a657-420c-9608-4a6a49d25bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-542499947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b148efe3-90ea-4bdd-a67d-d6317d10355c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce894e44a474c118f939c663219773a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:30:07Z,use_quota=True,user_id='cbd6c05796674d4a8e7f1f65fd475d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e4bf4d-095c-4cbe-bf9e-e0a1923ba51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e4bf4d-095c-4cbe-bf9e-e0a1923ba51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d3bd28-621f-482c-a5fc-9767ab58b3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d3bd28-621f-482c-a5fc-9767ab58b3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b148efe3-90ea-4bdd-a67d-d6317d10355c', 'volume_name': 'volume-b148efe3-90ea-4bdd-a67d-d6317d10355c', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dccb955-bd51-4bd6-9080-c1498b38ca30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dccb955-bd51-4bd6-9080-c1498b38ca30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a54f13-7eca-4383-8021-e3eeaae83153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:07 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Volume b148efe3-90ea-4bdd-a67d-d6317d10355c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b148efe3-90ea-4bdd-a67d-d6317d10355c', 'volume_size': 1} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-542499947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b148efe3-90ea-4bdd-a67d-d6317d10355c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce894e44a474c118f939c663219773a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:30:07Z,use_quota=True,user_id='cbd6c05796674d4a8e7f1f65fd475d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Creating volume b148efe3-90ea-4bdd-a67d-d6317d10355c {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:30:07 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b148efe3-90ea-4bdd-a67d-d6317d10355c 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:07 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b148efe3-90ea-4bdd-a67d-d6317d10355c 1073741824 Sep 09 18:30:07 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Flow 'volume_create_manager' (ef77f650-83c4-449a-9a0c-9c93730b2cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa8c692-620b-40fe-af67-65bd0c9fd658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa8c692-620b-40fe-af67-65bd0c9fd658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1426207799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce894e44a474c118f939c663219773a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:30:08Z,use_quota=True,user_id='cbd6c05796674d4a8e7f1f65fd475d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090d6f8f-2bb2-4990-850c-8c3c98aecd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090d6f8f-2bb2-4990-850c-8c3c98aecd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eafba56-2d01-4a0c-b37d-f90fb10daf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eafba56-2d01-4a0c-b37d-f90fb10daf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f', 'volume_name': 'volume-f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060e15ec-0d34-47d5-99bd-bb82d7b5eab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060e15ec-0d34-47d5-99bd-bb82d7b5eab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd546600-3e2f-420c-a6bd-250b57e67f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:07 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Volume f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f', 'volume_size': 1} Sep 09 18:30:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:07 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b148efe3-90ea-4bdd-a67d-d6317d10355c 1073741824" returned: 0 in 0.492s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b148efe3-90ea-4bdd-a67d-d6317d10355c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:08 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b148efe3-90ea-4bdd-a67d-d6317d10355c Sep 09 18:30:08 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Flow 'volume_create_manager' (667a7b59-a50d-4385-b594-29c19b9c9369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f53c3ac-d620-47fd-a63f-ae7628673a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f53c3ac-d620-47fd-a63f-ae7628673a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1902353875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a621e65c-e3f4-4d91-a74b-a8234ef74879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce894e44a474c118f939c663219773a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:30:08Z,use_quota=True,user_id='cbd6c05796674d4a8e7f1f65fd475d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3bde7d-9429-4153-b737-200b2f0f6e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3bde7d-9429-4153-b737-200b2f0f6e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375f14ce-56d2-4c70-8e92-4f966f0aac54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (375f14ce-56d2-4c70-8e92-4f966f0aac54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a621e65c-e3f4-4d91-a74b-a8234ef74879', 'volume_name': 'volume-a621e65c-e3f4-4d91-a74b-a8234ef74879', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1e68a2-1151-449f-b312-6b0edf33980e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1e68a2-1151-449f-b312-6b0edf33980e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4db3d55-c0d4-4ba1-b61e-f03b401af0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:08 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Volume a621e65c-e3f4-4d91-a74b-a8234ef74879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a621e65c-e3f4-4d91-a74b-a8234ef74879', 'volume_size': 1} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:08 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b148efe3-90ea-4bdd-a67d-d6317d10355c" returned: 0 in 0.282s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.504s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1426207799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce894e44a474c118f939c663219773a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:30:08Z,use_quota=True,user_id='cbd6c05796674d4a8e7f1f65fd475d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Creating volume f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:30:08 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a54f13-7eca-4383-8021-e3eeaae83153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b148efe3-90ea-4bdd-a67d-d6317d10355c', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb57956-68e2-4940-889f-dc33b49d3ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:08 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f 1073741824 Sep 09 18:30:08 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:08 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Volume volume-b148efe3-90ea-4bdd-a67d-d6317d10355c (b148efe3-90ea-4bdd-a67d-d6317d10355c): created successfully Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb57956-68e2-4940-889f-dc33b49d3ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Flow 'volume_create_manager' (70baba82-37b3-469b-ad22-a3f6d819e320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:08 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-b5bdc5db-4c9b-4460-961f-b294163efa95 tempest-CreateVolumesFromImageTest-1764185984 None] Created volume successfully. Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Flow 'volume_create_manager' (36061d6f-3031-43b9-b9d3-ec94a62267d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27321ba5-c3f7-4648-a2bd-c0c7f198837a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27321ba5-c3f7-4648-a2bd-c0c7f198837a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-755743103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d68dc7a-2ba7-489f-a918-920da5467b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce894e44a474c118f939c663219773a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:30:08Z,use_quota=True,user_id='cbd6c05796674d4a8e7f1f65fd475d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1d8668-07c4-4bf6-a614-198c00bfa005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1d8668-07c4-4bf6-a614-198c00bfa005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9556e59-3184-4a6c-9dba-8a14cd4599b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9556e59-3184-4a6c-9dba-8a14cd4599b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d68dc7a-2ba7-489f-a918-920da5467b4b', 'volume_name': 'volume-3d68dc7a-2ba7-489f-a918-920da5467b4b', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c5fc665-a8f1-47ff-bf66-7e4ff969a8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c5fc665-a8f1-47ff-bf66-7e4ff969a8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a27bfb-5302-48ef-ab2e-01d96c7359e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:08 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Volume 3d68dc7a-2ba7-489f-a918-920da5467b4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d68dc7a-2ba7-489f-a918-920da5467b4b', 'volume_size': 1} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:08 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f 1073741824" returned: 0 in 0.507s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Flow 'volume_create_manager' (c5380b72-bd16-4b77-9a6c-49b7427a52f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91bac5be-6f90-48b6-992f-4eb1b4f03433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91bac5be-6f90-48b6-992f-4eb1b4f03433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2120682322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b412414-720d-4cf8-9d15-338bb3ff8b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce894e44a474c118f939c663219773a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:30:09Z,use_quota=True,user_id='cbd6c05796674d4a8e7f1f65fd475d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a45d54-c21c-448d-9bed-8b43b07172ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a45d54-c21c-448d-9bed-8b43b07172ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed5af8c-33b2-4d9a-ae79-19d38ab81ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed5af8c-33b2-4d9a-ae79-19d38ab81ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b412414-720d-4cf8-9d15-338bb3ff8b03', 'volume_name': 'volume-2b412414-720d-4cf8-9d15-338bb3ff8b03', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7120892-7239-4494-8943-408b5f25affc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7120892-7239-4494-8943-408b5f25affc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d94179b-369b-4727-b281-8ca2858849fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:08 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Volume 2b412414-720d-4cf8-9d15-338bb3ff8b03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b412414-720d-4cf8-9d15-338bb3ff8b03', 'volume_size': 1} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:08 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f Sep 09 18:30:08 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:09 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f" returned: 0 in 0.245s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.004s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1902353875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a621e65c-e3f4-4d91-a74b-a8234ef74879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce894e44a474c118f939c663219773a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:30:08Z,use_quota=True,user_id='cbd6c05796674d4a8e7f1f65fd475d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Creating volume a621e65c-e3f4-4d91-a74b-a8234ef74879 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:30:09 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a621e65c-e3f4-4d91-a74b-a8234ef74879 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd546600-3e2f-420c-a6bd-250b57e67f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:09 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a621e65c-e3f4-4d91-a74b-a8234ef74879 1073741824 Sep 09 18:30:09 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b153caf4-3f87-418d-b569-23e1f5f221f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:09 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Volume volume-f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f (f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f): created successfully Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b153caf4-3f87-418d-b569-23e1f5f221f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Flow 'volume_create_manager' (ef77f650-83c4-449a-9a0c-9c93730b2cb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:09 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-381c9179-91b0-4324-9124-5fc71c0d4f58 tempest-CreateVolumesFromImageTest-1764185984 None] Created volume successfully. Sep 09 18:30:09 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a621e65c-e3f4-4d91-a74b-a8234ef74879 1073741824" returned: 0 in 0.403s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a621e65c-e3f4-4d91-a74b-a8234ef74879 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:09 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a621e65c-e3f4-4d91-a74b-a8234ef74879 Sep 09 18:30:09 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:09 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a621e65c-e3f4-4d91-a74b-a8234ef74879" returned: 0 in 0.248s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.316s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-755743103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d68dc7a-2ba7-489f-a918-920da5467b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce894e44a474c118f939c663219773a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:30:08Z,use_quota=True,user_id='cbd6c05796674d4a8e7f1f65fd475d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Creating volume 3d68dc7a-2ba7-489f-a918-920da5467b4b {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:30:09 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3d68dc7a-2ba7-489f-a918-920da5467b4b 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4db3d55-c0d4-4ba1-b61e-f03b401af0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a621e65c-e3f4-4d91-a74b-a8234ef74879', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:09 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3d68dc7a-2ba7-489f-a918-920da5467b4b 1073741824 Sep 09 18:30:09 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0363dabf-1c5a-4427-b90c-b817061a550b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:09 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Volume volume-a621e65c-e3f4-4d91-a74b-a8234ef74879 (a621e65c-e3f4-4d91-a74b-a8234ef74879): created successfully Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0363dabf-1c5a-4427-b90c-b817061a550b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Flow 'volume_create_manager' (667a7b59-a50d-4385-b594-29c19b9c9369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:09 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-2bb8813c-1308-4582-9a5f-1748bc15c1a0 tempest-CreateVolumesFromImageTest-1764185984 None] Created volume successfully. Sep 09 18:30:10 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3d68dc7a-2ba7-489f-a918-920da5467b4b 1073741824" returned: 0 in 0.427s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3d68dc7a-2ba7-489f-a918-920da5467b4b {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:10 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3d68dc7a-2ba7-489f-a918-920da5467b4b Sep 09 18:30:10 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:10 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3d68dc7a-2ba7-489f-a918-920da5467b4b" returned: 0 in 0.248s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:30:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.674s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2120682322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b412414-720d-4cf8-9d15-338bb3ff8b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce894e44a474c118f939c663219773a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:30:09Z,use_quota=True,user_id='cbd6c05796674d4a8e7f1f65fd475d63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:30:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Creating volume 2b412414-720d-4cf8-9d15-338bb3ff8b03 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:30:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:30:10 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:30:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2b412414-720d-4cf8-9d15-338bb3ff8b03 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a27bfb-5302-48ef-ab2e-01d96c7359e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d68dc7a-2ba7-489f-a918-920da5467b4b', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:10 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2b412414-720d-4cf8-9d15-338bb3ff8b03 1073741824 Sep 09 18:30:10 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d9dade6-bf40-47d4-ac15-760363a493c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:10 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Volume volume-3d68dc7a-2ba7-489f-a918-920da5467b4b (3d68dc7a-2ba7-489f-a918-920da5467b4b): created successfully Sep 09 18:30:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d9dade6-bf40-47d4-ac15-760363a493c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Flow 'volume_create_manager' (36061d6f-3031-43b9-b9d3-ec94a62267d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:10 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-2ee34c2a-25c2-4515-b18a-f1451a110cc0 tempest-CreateVolumesFromImageTest-1764185984 None] Created volume successfully. Sep 09 18:30:11 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2b412414-720d-4cf8-9d15-338bb3ff8b03 1073741824" returned: 0 in 0.401s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2b412414-720d-4cf8-9d15-338bb3ff8b03 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:11 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2b412414-720d-4cf8-9d15-338bb3ff8b03 Sep 09 18:30:11 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:11 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2b412414-720d-4cf8-9d15-338bb3ff8b03" returned: 0 in 0.242s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:30:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d94179b-369b-4727-b281-8ca2858849fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b412414-720d-4cf8-9d15-338bb3ff8b03', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7314dc6-8a08-48e4-9aa7-b7c10340307c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:11 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Volume volume-2b412414-720d-4cf8-9d15-338bb3ff8b03 (2b412414-720d-4cf8-9d15-338bb3ff8b03): created successfully Sep 09 18:30:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7314dc6-8a08-48e4-9aa7-b7c10340307c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Flow 'volume_create_manager' (c5380b72-bd16-4b77-9a6c-49b7427a52f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:11 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-76746f6b-34c3-4ff0-8d02-c31b7588d04e tempest-CreateVolumesFromImageTest-1764185984 None] Created volume successfully. Sep 09 18:30:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-55729271-f408-4096-aa0e-cc21b4e1ed43 tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "cinder-2b412414-720d-4cf8-9d15-338bb3ff8b03-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-55729271-f408-4096-aa0e-cc21b4e1ed43 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "cinder-2b412414-720d-4cf8-9d15-338bb3ff8b03-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-55729271-f408-4096-aa0e-cc21b4e1ed43 tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "cinder-quobyte-2b412414-720d-4cf8-9d15-338bb3ff8b03" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-55729271-f408-4096-aa0e-cc21b4e1ed43 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "cinder-quobyte-2b412414-720d-4cf8-9d15-338bb3ff8b03" acquired by "delete_volume" :: waited 0.014s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:12 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe858ed7-85d9-4f0f-80c8-1496ea645c64]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:30:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-55729271-f408-4096-aa0e-cc21b4e1ed43 tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2b412414-720d-4cf8-9d15-338bb3ff8b03 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:12 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2b412414-720d-4cf8-9d15-338bb3ff8b03 Sep 09 18:30:12 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:12 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-55729271-f408-4096-aa0e-cc21b4e1ed43 tempest-CreateVolumesFromImageTest-1764185984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2b412414-720d-4cf8-9d15-338bb3ff8b03" returned: 0 in 0.359s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-55729271-f408-4096-aa0e-cc21b4e1ed43 tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2b412414-720d-4cf8-9d15-338bb3ff8b03 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:12 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2b412414-720d-4cf8-9d15-338bb3ff8b03 Sep 09 18:30:12 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:12 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-55729271-f408-4096-aa0e-cc21b4e1ed43 tempest-CreateVolumesFromImageTest-1764185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2b412414-720d-4cf8-9d15-338bb3ff8b03" returned: 0 in 0.243s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-55729271-f408-4096-aa0e-cc21b4e1ed43 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "cinder-quobyte-2b412414-720d-4cf8-9d15-338bb3ff8b03" released by "delete_volume" :: held 0.641s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:12 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-55729271-f408-4096-aa0e-cc21b4e1ed43 tempest-CreateVolumesFromImageTest-1764185984 None] Created reservations ['c3277833-3162-46f5-93a8-d968d0233082', '41ff4cc4-acf6-4450-afab-d20247a378f2', 'a5107630-3205-4722-9c64-c80d8450481a', '2c2db5bf-4780-43b5-b527-c6db38530dc8'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:30:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-55729271-f408-4096-aa0e-cc21b4e1ed43 tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-55729271-f408-4096-aa0e-cc21b4e1ed43 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-55729271-f408-4096-aa0e-cc21b4e1ed43 tempest-CreateVolumesFromImageTest-1764185984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-55729271-f408-4096-aa0e-cc21b4e1ed43 tempest-CreateVolumesFromImageTest-1764185984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-55729271-f408-4096-aa0e-cc21b4e1ed43 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-55729271-f408-4096-aa0e-cc21b4e1ed43 tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:13 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:30:13 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:13 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-55729271-f408-4096-aa0e-cc21b4e1ed43 tempest-CreateVolumesFromImageTest-1764185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.245s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:13 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-55729271-f408-4096-aa0e-cc21b4e1ed43 tempest-CreateVolumesFromImageTest-1764185984 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:30:13 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-55729271-f408-4096-aa0e-cc21b4e1ed43 tempest-CreateVolumesFromImageTest-1764185984 None] Deleted volume successfully. Sep 09 18:30:13 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-55729271-f408-4096-aa0e-cc21b4e1ed43 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "cinder-2b412414-720d-4cf8-9d15-338bb3ff8b03-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:13 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-42016c85-2332-4757-9ea4-befbcc21ba09 tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "cinder-3d68dc7a-2ba7-489f-a918-920da5467b4b-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:13 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-42016c85-2332-4757-9ea4-befbcc21ba09 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "cinder-3d68dc7a-2ba7-489f-a918-920da5467b4b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:13 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-42016c85-2332-4757-9ea4-befbcc21ba09 tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "cinder-quobyte-3d68dc7a-2ba7-489f-a918-920da5467b4b" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:13 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-42016c85-2332-4757-9ea4-befbcc21ba09 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "cinder-quobyte-3d68dc7a-2ba7-489f-a918-920da5467b4b" acquired by "delete_volume" :: waited 0.015s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:13 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf792a73-ef1b-4b46-9004-f6dba8a7ff26]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:30:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-42016c85-2332-4757-9ea4-befbcc21ba09 tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3d68dc7a-2ba7-489f-a918-920da5467b4b {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:13 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3d68dc7a-2ba7-489f-a918-920da5467b4b Sep 09 18:30:13 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:13 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-42016c85-2332-4757-9ea4-befbcc21ba09 tempest-CreateVolumesFromImageTest-1764185984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3d68dc7a-2ba7-489f-a918-920da5467b4b" returned: 0 in 0.345s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-42016c85-2332-4757-9ea4-befbcc21ba09 tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3d68dc7a-2ba7-489f-a918-920da5467b4b {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:13 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3d68dc7a-2ba7-489f-a918-920da5467b4b Sep 09 18:30:13 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:14 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-42016c85-2332-4757-9ea4-befbcc21ba09 tempest-CreateVolumesFromImageTest-1764185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3d68dc7a-2ba7-489f-a918-920da5467b4b" returned: 0 in 0.236s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:14 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-42016c85-2332-4757-9ea4-befbcc21ba09 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "cinder-quobyte-3d68dc7a-2ba7-489f-a918-920da5467b4b" released by "delete_volume" :: held 0.619s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:14 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-42016c85-2332-4757-9ea4-befbcc21ba09 tempest-CreateVolumesFromImageTest-1764185984 None] Created reservations ['bca439a8-564f-4622-969d-ac0939ca98af', '7de43dab-a18a-40d9-a50c-8f49c5cc3ca3', '3f40fb28-0037-4841-a069-274acc7065c5', '1afde192-55df-4a7b-bd27-a560e89e6dab'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:30:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-42016c85-2332-4757-9ea4-befbcc21ba09 tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-42016c85-2332-4757-9ea4-befbcc21ba09 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-42016c85-2332-4757-9ea4-befbcc21ba09 tempest-CreateVolumesFromImageTest-1764185984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-42016c85-2332-4757-9ea4-befbcc21ba09 tempest-CreateVolumesFromImageTest-1764185984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-42016c85-2332-4757-9ea4-befbcc21ba09 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-42016c85-2332-4757-9ea4-befbcc21ba09 tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:14 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:30:14 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:14 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-42016c85-2332-4757-9ea4-befbcc21ba09 tempest-CreateVolumesFromImageTest-1764185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.233s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:14 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-42016c85-2332-4757-9ea4-befbcc21ba09 tempest-CreateVolumesFromImageTest-1764185984 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:30:14 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-42016c85-2332-4757-9ea4-befbcc21ba09 tempest-CreateVolumesFromImageTest-1764185984 None] Deleted volume successfully. Sep 09 18:30:14 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-42016c85-2332-4757-9ea4-befbcc21ba09 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "cinder-3d68dc7a-2ba7-489f-a918-920da5467b4b-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:14 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-aea94320-ae08-4374-91a7-94b52f0ac623 tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "cinder-a621e65c-e3f4-4d91-a74b-a8234ef74879-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:14 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-aea94320-ae08-4374-91a7-94b52f0ac623 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "cinder-a621e65c-e3f4-4d91-a74b-a8234ef74879-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:14 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-aea94320-ae08-4374-91a7-94b52f0ac623 tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "cinder-quobyte-a621e65c-e3f4-4d91-a74b-a8234ef74879" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:14 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-aea94320-ae08-4374-91a7-94b52f0ac623 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "cinder-quobyte-a621e65c-e3f4-4d91-a74b-a8234ef74879" acquired by "delete_volume" :: waited 0.014s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:14 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b510bd6-4522-4c3b-88ea-4eadf14a11ff]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:30:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aea94320-ae08-4374-91a7-94b52f0ac623 tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a621e65c-e3f4-4d91-a74b-a8234ef74879 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:14 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a621e65c-e3f4-4d91-a74b-a8234ef74879 Sep 09 18:30:14 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:14 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aea94320-ae08-4374-91a7-94b52f0ac623 tempest-CreateVolumesFromImageTest-1764185984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a621e65c-e3f4-4d91-a74b-a8234ef74879" returned: 0 in 0.347s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aea94320-ae08-4374-91a7-94b52f0ac623 tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a621e65c-e3f4-4d91-a74b-a8234ef74879 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:14 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a621e65c-e3f4-4d91-a74b-a8234ef74879 Sep 09 18:30:14 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:15 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aea94320-ae08-4374-91a7-94b52f0ac623 tempest-CreateVolumesFromImageTest-1764185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-a621e65c-e3f4-4d91-a74b-a8234ef74879" returned: 0 in 0.239s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-aea94320-ae08-4374-91a7-94b52f0ac623 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "cinder-quobyte-a621e65c-e3f4-4d91-a74b-a8234ef74879" released by "delete_volume" :: held 0.627s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:15 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-aea94320-ae08-4374-91a7-94b52f0ac623 tempest-CreateVolumesFromImageTest-1764185984 None] Created reservations ['6d121eae-c713-41de-b19a-519f9bf0aa7e', '91ebfa48-6c0a-4f21-a91c-fbaf3044d1b6', 'fe6db207-3f11-4506-8251-a529a8be9878', 'd57a99ce-5656-4079-b53c-07513d84deab'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:30:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-aea94320-ae08-4374-91a7-94b52f0ac623 tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-aea94320-ae08-4374-91a7-94b52f0ac623 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:15 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-aea94320-ae08-4374-91a7-94b52f0ac623 tempest-CreateVolumesFromImageTest-1764185984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:15 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-aea94320-ae08-4374-91a7-94b52f0ac623 tempest-CreateVolumesFromImageTest-1764185984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-aea94320-ae08-4374-91a7-94b52f0ac623 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aea94320-ae08-4374-91a7-94b52f0ac623 tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:15 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:30:15 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:15 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aea94320-ae08-4374-91a7-94b52f0ac623 tempest-CreateVolumesFromImageTest-1764185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.239s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:15 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-aea94320-ae08-4374-91a7-94b52f0ac623 tempest-CreateVolumesFromImageTest-1764185984 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:30:15 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-aea94320-ae08-4374-91a7-94b52f0ac623 tempest-CreateVolumesFromImageTest-1764185984 None] Deleted volume successfully. Sep 09 18:30:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-aea94320-ae08-4374-91a7-94b52f0ac623 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "cinder-a621e65c-e3f4-4d91-a74b-a8234ef74879-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-304122e4-dda7-4984-9905-a1779450646d tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "cinder-f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-304122e4-dda7-4984-9905-a1779450646d tempest-CreateVolumesFromImageTest-1764185984 None] Lock "cinder-f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-304122e4-dda7-4984-9905-a1779450646d tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "cinder-quobyte-f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-304122e4-dda7-4984-9905-a1779450646d tempest-CreateVolumesFromImageTest-1764185984 None] Lock "cinder-quobyte-f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f" acquired by "delete_volume" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:15 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf6c3a7-75dd-4fe5-ad49-3c3437dfa08d]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:30:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-304122e4-dda7-4984-9905-a1779450646d tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:15 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f Sep 09 18:30:15 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:16 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-304122e4-dda7-4984-9905-a1779450646d tempest-CreateVolumesFromImageTest-1764185984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f" returned: 0 in 0.348s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-304122e4-dda7-4984-9905-a1779450646d tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:16 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f Sep 09 18:30:16 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:16 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-304122e4-dda7-4984-9905-a1779450646d tempest-CreateVolumesFromImageTest-1764185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f" returned: 0 in 0.234s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-304122e4-dda7-4984-9905-a1779450646d tempest-CreateVolumesFromImageTest-1764185984 None] Lock "cinder-quobyte-f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f" released by "delete_volume" :: held 0.623s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:16 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-304122e4-dda7-4984-9905-a1779450646d tempest-CreateVolumesFromImageTest-1764185984 None] Created reservations ['090a347a-59c4-43ec-a9f1-855f6749438e', '7b887f92-4165-47e6-8f7c-765fafa6bef8', 'fac8902e-896f-481d-9881-296b16e1d5bb', 'ff4234fc-4364-4609-9953-b582aac375ca'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:30:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-304122e4-dda7-4984-9905-a1779450646d tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-304122e4-dda7-4984-9905-a1779450646d tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-304122e4-dda7-4984-9905-a1779450646d tempest-CreateVolumesFromImageTest-1764185984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-304122e4-dda7-4984-9905-a1779450646d tempest-CreateVolumesFromImageTest-1764185984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-304122e4-dda7-4984-9905-a1779450646d tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-304122e4-dda7-4984-9905-a1779450646d tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:16 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:30:16 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:16 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-304122e4-dda7-4984-9905-a1779450646d tempest-CreateVolumesFromImageTest-1764185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.242s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:16 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-304122e4-dda7-4984-9905-a1779450646d tempest-CreateVolumesFromImageTest-1764185984 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:30:16 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-304122e4-dda7-4984-9905-a1779450646d tempest-CreateVolumesFromImageTest-1764185984 None] Deleted volume successfully. Sep 09 18:30:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-304122e4-dda7-4984-9905-a1779450646d tempest-CreateVolumesFromImageTest-1764185984 None] Lock "cinder-f6c984fd-1bfa-4825-9bd4-98e4b1b47b0f-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d6fe5875-3c9a-433a-a36e-122ba4e4e8f3 tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "cinder-b148efe3-90ea-4bdd-a67d-d6317d10355c-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d6fe5875-3c9a-433a-a36e-122ba4e4e8f3 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "cinder-b148efe3-90ea-4bdd-a67d-d6317d10355c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d6fe5875-3c9a-433a-a36e-122ba4e4e8f3 tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "cinder-quobyte-b148efe3-90ea-4bdd-a67d-d6317d10355c" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d6fe5875-3c9a-433a-a36e-122ba4e4e8f3 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "cinder-quobyte-b148efe3-90ea-4bdd-a67d-d6317d10355c" acquired by "delete_volume" :: waited 0.014s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:16 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e589a0-6df9-45b2-a7eb-c40a99f9b8b2]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:30:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d6fe5875-3c9a-433a-a36e-122ba4e4e8f3 tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b148efe3-90ea-4bdd-a67d-d6317d10355c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:17 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b148efe3-90ea-4bdd-a67d-d6317d10355c Sep 09 18:30:17 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:17 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d6fe5875-3c9a-433a-a36e-122ba4e4e8f3 tempest-CreateVolumesFromImageTest-1764185984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b148efe3-90ea-4bdd-a67d-d6317d10355c" returned: 0 in 0.339s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d6fe5875-3c9a-433a-a36e-122ba4e4e8f3 tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b148efe3-90ea-4bdd-a67d-d6317d10355c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:17 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b148efe3-90ea-4bdd-a67d-d6317d10355c Sep 09 18:30:17 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:17 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d6fe5875-3c9a-433a-a36e-122ba4e4e8f3 tempest-CreateVolumesFromImageTest-1764185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b148efe3-90ea-4bdd-a67d-d6317d10355c" returned: 0 in 0.242s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:17 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d6fe5875-3c9a-433a-a36e-122ba4e4e8f3 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "cinder-quobyte-b148efe3-90ea-4bdd-a67d-d6317d10355c" released by "delete_volume" :: held 0.616s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:17 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-d6fe5875-3c9a-433a-a36e-122ba4e4e8f3 tempest-CreateVolumesFromImageTest-1764185984 None] Created reservations ['4d329c29-8dcd-46cc-8444-83862f242875', 'fc7c7afa-d985-4022-828c-0fb44703d7b8', '59e3411c-a787-46fb-967e-25baffd50884', 'c9fb5175-b301-4af6-bfad-d5afb1079a6e'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:30:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d6fe5875-3c9a-433a-a36e-122ba4e4e8f3 tempest-CreateVolumesFromImageTest-1764185984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d6fe5875-3c9a-433a-a36e-122ba4e4e8f3 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d6fe5875-3c9a-433a-a36e-122ba4e4e8f3 tempest-CreateVolumesFromImageTest-1764185984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d6fe5875-3c9a-433a-a36e-122ba4e4e8f3 tempest-CreateVolumesFromImageTest-1764185984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d6fe5875-3c9a-433a-a36e-122ba4e4e8f3 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d6fe5875-3c9a-433a-a36e-122ba4e4e8f3 tempest-CreateVolumesFromImageTest-1764185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:17 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:30:17 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:17 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d6fe5875-3c9a-433a-a36e-122ba4e4e8f3 tempest-CreateVolumesFromImageTest-1764185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.233s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:17 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-d6fe5875-3c9a-433a-a36e-122ba4e4e8f3 tempest-CreateVolumesFromImageTest-1764185984 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:30:17 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d6fe5875-3c9a-433a-a36e-122ba4e4e8f3 tempest-CreateVolumesFromImageTest-1764185984 None] Deleted volume successfully. Sep 09 18:30:17 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d6fe5875-3c9a-433a-a36e-122ba4e4e8f3 tempest-CreateVolumesFromImageTest-1764185984 None] Lock "cinder-b148efe3-90ea-4bdd-a67d-d6317d10355c-delete_volume" released by "delete_volume" :: held 1.027s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Flow 'volume_create_manager' (c6027dfa-bb3a-4675-a440-fbeb4ff5e185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d54bab-54ca-4e7d-b7a9-15f777f6e53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d54bab-54ca-4e7d-b7a9-15f777f6e53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1705279050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9615f37-164c-4386-8d40-3ad95aa7bf8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a76ce5b4e1e48c98aa353f1de892c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:30:20Z,use_quota=True,user_id='fc277ca1543a48469ef8f96e2c28e144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e8ac6d-eb39-4ffb-8e72-337343b21e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e8ac6d-eb39-4ffb-8e72-337343b21e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a236f3-e4db-4641-b197-734e3245561b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a236f3-e4db-4641-b197-734e3245561b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9615f37-164c-4386-8d40-3ad95aa7bf8e', 'volume_name': 'volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e9501f-7b2b-4cf7-98ac-51bd77cce956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e9501f-7b2b-4cf7-98ac-51bd77cce956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce754b9-071a-4a20-a7ee-bd7cee351717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:20 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Volume d9615f37-164c-4386-8d40-3ad95aa7bf8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e', 'volume_size': 1} Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1705279050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9615f37-164c-4386-8d40-3ad95aa7bf8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a76ce5b4e1e48c98aa353f1de892c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:30:20Z,use_quota=True,user_id='fc277ca1543a48469ef8f96e2c28e144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Creating volume d9615f37-164c-4386-8d40-3ad95aa7bf8e {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:30:20 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:20 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e 1073741824 Sep 09 18:30:20 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:20 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e 1073741824" returned: 0 in 0.384s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:21 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e Sep 09 18:30:21 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:21 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e" returned: 0 in 0.241s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:30:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce754b9-071a-4a20-a7ee-bd7cee351717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a303177-c32f-4c70-9ab2-65b8cc6c6f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:21 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Volume volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e (d9615f37-164c-4386-8d40-3ad95aa7bf8e): created successfully Sep 09 18:30:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a303177-c32f-4c70-9ab2-65b8cc6c6f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Flow 'volume_create_manager' (c6027dfa-bb3a-4675-a440-fbeb4ff5e185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:21 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-699e33b9-6ef3-45d3-ab89-da5190c216ca tempest-VolumeDependencyTests-1908634988 None] Created volume successfully. Sep 09 18:30:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c950ca9a-3371-404e-b9f7-9721a2dd8e22 tempest-VolumeDependencyTests-1908634988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c950ca9a-3371-404e-b9f7-9721a2dd8e22 tempest-VolumeDependencyTests-1908634988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-c950ca9a-3371-404e-b9f7-9721a2dd8e22 tempest-VolumeDependencyTests-1908634988 None] Creating offline snapshot 40321449-c5ae-4311-bd40-3386996f5cd2 of volume d9615f37-164c-4386-8d40-3ad95aa7bf8e {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:30:21 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1005378-d199-4322-8032-011afdf9256c]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:30:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c950ca9a-3371-404e-b9f7-9721a2dd8e22 tempest-VolumeDependencyTests-1908634988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:21 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e Sep 09 18:30:21 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:22 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c950ca9a-3371-404e-b9f7-9721a2dd8e22 tempest-VolumeDependencyTests-1908634988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e" returned: 0 in 0.352s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c950ca9a-3371-404e-b9f7-9721a2dd8e22 tempest-VolumeDependencyTests-1908634988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:22 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2 1G Sep 09 18:30:22 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:22 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c950ca9a-3371-404e-b9f7-9721a2dd8e22 tempest-VolumeDependencyTests-1908634988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2 1G" returned: 0 in 0.367s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c950ca9a-3371-404e-b9f7-9721a2dd8e22 tempest-VolumeDependencyTests-1908634988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:22 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2 Sep 09 18:30:22 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:22 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c950ca9a-3371-404e-b9f7-9721a2dd8e22 tempest-VolumeDependencyTests-1908634988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2" returned: 0 in 0.288s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:22 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-c950ca9a-3371-404e-b9f7-9721a2dd8e22 tempest-VolumeDependencyTests-1908634988 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2 is being set with open permissions: ugo+rw Sep 09 18:30:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c950ca9a-3371-404e-b9f7-9721a2dd8e22 tempest-VolumeDependencyTests-1908634988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:22 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2 Sep 09 18:30:22 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:22 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c950ca9a-3371-404e-b9f7-9721a2dd8e22 tempest-VolumeDependencyTests-1908634988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2" returned: 0 in 0.235s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c950ca9a-3371-404e-b9f7-9721a2dd8e22 tempest-VolumeDependencyTests-1908634988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:22 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.info Sep 09 18:30:22 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:23 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c950ca9a-3371-404e-b9f7-9721a2dd8e22 tempest-VolumeDependencyTests-1908634988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.info" returned: 0 in 0.249s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:23 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-c950ca9a-3371-404e-b9f7-9721a2dd8e22 tempest-VolumeDependencyTests-1908634988 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.info is being set with open permissions: ugo+rw Sep 09 18:30:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c950ca9a-3371-404e-b9f7-9721a2dd8e22 tempest-VolumeDependencyTests-1908634988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:23 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.info Sep 09 18:30:23 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:23 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c950ca9a-3371-404e-b9f7-9721a2dd8e22 tempest-VolumeDependencyTests-1908634988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.info" returned: 0 in 0.231s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c950ca9a-3371-404e-b9f7-9721a2dd8e22 tempest-VolumeDependencyTests-1908634988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.801s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:23 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-c950ca9a-3371-404e-b9f7-9721a2dd8e22 tempest-VolumeDependencyTests-1908634988 None] Create snapshot completed successfully Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Flow 'volume_create_manager' (2a392426-7845-4c35-a44e-e1e5e49ebab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed63103c-111b-4170-bac8-632ccfcc1ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed63103c-111b-4170-bac8-632ccfcc1ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1653829114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f679af7-1ba1-4302-b1b4-ee10d1ac8210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a76ce5b4e1e48c98aa353f1de892c31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=40321449-c5ae-4311-bd40-3386996f5cd2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:30:24Z,use_quota=True,user_id='fc277ca1543a48469ef8f96e2c28e144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d8c9a2-5439-40e3-8ef6-255c5397b161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d8c9a2-5439-40e3-8ef6-255c5397b161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa192fa1-e9d2-4a18-b540-a26043bbf1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa192fa1-e9d2-4a18-b540-a26043bbf1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9f679af7-1ba1-4302-b1b4-ee10d1ac8210', 'volume_name': 'volume-9f679af7-1ba1-4302-b1b4-ee10d1ac8210', 'volume_size': 1, 'snapshot_id': '40321449-c5ae-4311-bd40-3386996f5cd2'}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3406901f-c114-4b80-bfcd-d6ec8ae69bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3406901f-c114-4b80-bfcd-d6ec8ae69bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf2abff-934c-41f3-8ee4-fbf3085bcc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:24 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Volume 9f679af7-1ba1-4302-b1b4-ee10d1ac8210: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9f679af7-1ba1-4302-b1b4-ee10d1ac8210', 'volume_size': 1, 'snapshot_id': '40321449-c5ae-4311-bd40-3386996f5cd2'} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Acquiring lock "cinder-quobyte-40321449-c5ae-4311-bd40-3386996f5cd2-9f679af7-1ba1-4302-b1b4-ee10d1ac8210" by "_create_volume_from_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Lock "cinder-quobyte-40321449-c5ae-4311-bd40-3386996f5cd2-9f679af7-1ba1-4302-b1b4-ee10d1ac8210" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Creating volume 9f679af7-1ba1-4302-b1b4-ee10d1ac8210 from snapshot 40321449-c5ae-4311-bd40-3386996f5cd2 {{(pid=87639) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Acquiring lock "cinder-quobyte-9f679af7-1ba1-4302-b1b4-ee10d1ac8210" by "_copy_volume_from_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Lock "cinder-quobyte-9f679af7-1ba1-4302-b1b4-ee10d1ac8210" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] snapshot: 40321449-c5ae-4311-bd40-3386996f5cd2, volume: 9f679af7-1ba1-4302-b1b4-ee10d1ac8210, {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4524077c-fbf5-472e-924e-90777a201965]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:24 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2 Sep 09 18:30:24 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:24 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2" returned: 0 in 0.349s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3778b7a5-c32c-40a5-a8f0-fa87ecdfeb8f]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:30:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:24 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e Sep 09 18:30:24 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:25 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e" returned: 0 in 0.354s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:25 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 18:30:25 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Creating direct copy from snapshot {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 18:30:25 devstack cinder-volume[87639]: DEBUG cinder.utils [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Path /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f679af7-1ba1-4302-b1b4-ee10d1ac8210 not found in is_blk_device check {{(pid=87639) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 18:30:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f679af7-1ba1-4302-b1b4-ee10d1ac8210 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:25 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f679af7-1ba1-4302-b1b4-ee10d1ac8210 Sep 09 18:30:25 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:29 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f679af7-1ba1-4302-b1b4-ee10d1ac8210" returned: 0 in 4.226s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:29 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Image conversion details: src /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e, size 1024.00 MB, duration 4.23 sec, destination /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f679af7-1ba1-4302-b1b4-ee10d1ac8210 {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:30:29 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Converted 1024.00 MB image at 242.24 MB/s Sep 09 18:30:29 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f679af7-1ba1-4302-b1b4-ee10d1ac8210 is being set with open permissions: ugo+rw Sep 09 18:30:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f679af7-1ba1-4302-b1b4-ee10d1ac8210 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:29 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f679af7-1ba1-4302-b1b4-ee10d1ac8210 Sep 09 18:30:29 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:29 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f679af7-1ba1-4302-b1b4-ee10d1ac8210" returned: 0 in 0.237s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Lock "cinder-quobyte-9f679af7-1ba1-4302-b1b4-ee10d1ac8210" released by "_copy_volume_from_snapshot" :: held 5.235s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Lock "cinder-quobyte-40321449-c5ae-4311-bd40-3386996f5cd2-9f679af7-1ba1-4302-b1b4-ee10d1ac8210" released by "_create_volume_from_snapshot" :: held 5.294s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.307s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf2abff-934c-41f3-8ee4-fbf3085bcc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f679af7-1ba1-4302-b1b4-ee10d1ac8210', 'volume_size': 1, 'snapshot_id': '40321449-c5ae-4311-bd40-3386996f5cd2'}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d05fd1-4140-49c5-ad16-f3fa2f2f016f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:29 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Volume volume-9f679af7-1ba1-4302-b1b4-ee10d1ac8210 (9f679af7-1ba1-4302-b1b4-ee10d1ac8210): created successfully Sep 09 18:30:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d05fd1-4140-49c5-ad16-f3fa2f2f016f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:29 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Flow 'volume_create_manager' (2a392426-7845-4c35-a44e-e1e5e49ebab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:29 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-02184f36-710e-47f8-a0b3-e4a8a6197fe7 tempest-VolumeDependencyTests-1908634988 None] Created volume successfully. Sep 09 18:30:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1983c00f-2f5a-47df-bec2-9ef57a897326 tempest-VolumeDependencyTests-1908634988 None] Acquiring lock "cinder-40321449-c5ae-4311-bd40-3386996f5cd2-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1983c00f-2f5a-47df-bec2-9ef57a897326 tempest-VolumeDependencyTests-1908634988 None] Lock "cinder-40321449-c5ae-4311-bd40-3386996f5cd2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1983c00f-2f5a-47df-bec2-9ef57a897326 tempest-VolumeDependencyTests-1908634988 None] Acquiring lock "cinder-quobyte-d9615f37-164c-4386-8d40-3ad95aa7bf8e" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1983c00f-2f5a-47df-bec2-9ef57a897326 tempest-VolumeDependencyTests-1908634988 None] Lock "cinder-quobyte-d9615f37-164c-4386-8d40-3ad95aa7bf8e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1983c00f-2f5a-47df-bec2-9ef57a897326 tempest-VolumeDependencyTests-1908634988 None] Acquiring lock "cinder-quobyte-40321449-c5ae-4311-bd40-3386996f5cd2" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1983c00f-2f5a-47df-bec2-9ef57a897326 tempest-VolumeDependencyTests-1908634988 None] Lock "cinder-quobyte-40321449-c5ae-4311-bd40-3386996f5cd2" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:30 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-1983c00f-2f5a-47df-bec2-9ef57a897326 tempest-VolumeDependencyTests-1908634988 None] Deleting offline snapshot 40321449-c5ae-4311-bd40-3386996f5cd2 of volume d9615f37-164c-4386-8d40-3ad95aa7bf8e {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:30:30 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-1983c00f-2f5a-47df-bec2-9ef57a897326 tempest-VolumeDependencyTests-1908634988 None] snapshot_file for this snap is: volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:30:30 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f04ae8-d034-4490-ac0c-e2ce0f99ea2b]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:30:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1983c00f-2f5a-47df-bec2-9ef57a897326 tempest-VolumeDependencyTests-1908634988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:31 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2 Sep 09 18:30:31 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:31 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1983c00f-2f5a-47df-bec2-9ef57a897326 tempest-VolumeDependencyTests-1908634988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2" returned: 0 in 0.373s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-1983c00f-2f5a-47df-bec2-9ef57a897326 tempest-VolumeDependencyTests-1908634988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:30:31 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[371a1658-66bb-4f51-9275-cf01b77b352c]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:30:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1983c00f-2f5a-47df-bec2-9ef57a897326 tempest-VolumeDependencyTests-1908634988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:31 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e Sep 09 18:30:31 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:31 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1983c00f-2f5a-47df-bec2-9ef57a897326 tempest-VolumeDependencyTests-1908634988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e" returned: 0 in 0.524s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1983c00f-2f5a-47df-bec2-9ef57a897326 tempest-VolumeDependencyTests-1908634988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:31 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2 Sep 09 18:30:31 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:32 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1983c00f-2f5a-47df-bec2-9ef57a897326 tempest-VolumeDependencyTests-1908634988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2" returned: 0 in 0.320s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1983c00f-2f5a-47df-bec2-9ef57a897326 tempest-VolumeDependencyTests-1908634988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:32 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2 Sep 09 18:30:32 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:32 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1983c00f-2f5a-47df-bec2-9ef57a897326 tempest-VolumeDependencyTests-1908634988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e.40321449-c5ae-4311-bd40-3386996f5cd2" returned: 0 in 0.238s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1983c00f-2f5a-47df-bec2-9ef57a897326 tempest-VolumeDependencyTests-1908634988 None] Lock "cinder-quobyte-40321449-c5ae-4311-bd40-3386996f5cd2" released by "_delete_snapshot" :: held 1.542s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1983c00f-2f5a-47df-bec2-9ef57a897326 tempest-VolumeDependencyTests-1908634988 None] Lock "cinder-quobyte-d9615f37-164c-4386-8d40-3ad95aa7bf8e" released by "delete_snapshot" :: held 1.561s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:32 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-1983c00f-2f5a-47df-bec2-9ef57a897326 tempest-VolumeDependencyTests-1908634988 None] Created reservations ['14a2503f-8771-490d-a5bd-9f66b2012265', 'baa0d894-daa6-4c67-9ddd-3cc738c1f4d1', '15969f3d-d7e9-49b6-8077-4a9d96317c57', '76949005-9a01-4a41-a689-d0e3ee7a28c6'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:30:32 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-1983c00f-2f5a-47df-bec2-9ef57a897326 tempest-VolumeDependencyTests-1908634988 None] Delete snapshot completed successfully. Sep 09 18:30:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1983c00f-2f5a-47df-bec2-9ef57a897326 tempest-VolumeDependencyTests-1908634988 None] Lock "cinder-40321449-c5ae-4311-bd40-3386996f5cd2-delete_snapshot" released by "delete_snapshot" :: held 1.692s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1dc87324-9155-4a76-a640-11b608912a69 tempest-VolumeDependencyTests-1908634988 None] Acquiring lock "cinder-d9615f37-164c-4386-8d40-3ad95aa7bf8e-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1dc87324-9155-4a76-a640-11b608912a69 tempest-VolumeDependencyTests-1908634988 None] Lock "cinder-d9615f37-164c-4386-8d40-3ad95aa7bf8e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1dc87324-9155-4a76-a640-11b608912a69 tempest-VolumeDependencyTests-1908634988 None] Acquiring lock "cinder-quobyte-d9615f37-164c-4386-8d40-3ad95aa7bf8e" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1dc87324-9155-4a76-a640-11b608912a69 tempest-VolumeDependencyTests-1908634988 None] Lock "cinder-quobyte-d9615f37-164c-4386-8d40-3ad95aa7bf8e" acquired by "delete_volume" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:33 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[428e6e2b-e739-4dd6-bad1-7fd985d02a6c]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:30:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1dc87324-9155-4a76-a640-11b608912a69 tempest-VolumeDependencyTests-1908634988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:33 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e Sep 09 18:30:33 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:33 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1dc87324-9155-4a76-a640-11b608912a69 tempest-VolumeDependencyTests-1908634988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e" returned: 0 in 0.347s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1dc87324-9155-4a76-a640-11b608912a69 tempest-VolumeDependencyTests-1908634988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:33 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e Sep 09 18:30:33 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:33 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1dc87324-9155-4a76-a640-11b608912a69 tempest-VolumeDependencyTests-1908634988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d9615f37-164c-4386-8d40-3ad95aa7bf8e" returned: 0 in 0.243s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1dc87324-9155-4a76-a640-11b608912a69 tempest-VolumeDependencyTests-1908634988 None] Lock "cinder-quobyte-d9615f37-164c-4386-8d40-3ad95aa7bf8e" released by "delete_volume" :: held 0.641s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:33 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-1dc87324-9155-4a76-a640-11b608912a69 tempest-VolumeDependencyTests-1908634988 None] Created reservations ['0b1588bf-a178-4f96-91a1-a397d2a13c1f', 'b3a2337e-bf4b-4d36-ba09-99ba08e157fa', 'a6108841-05c2-4469-bbf9-da84fa21db58', '3a610b1f-0e8e-4010-bbe2-9915b8a1e373'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:30:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1dc87324-9155-4a76-a640-11b608912a69 tempest-VolumeDependencyTests-1908634988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1dc87324-9155-4a76-a640-11b608912a69 tempest-VolumeDependencyTests-1908634988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1dc87324-9155-4a76-a640-11b608912a69 tempest-VolumeDependencyTests-1908634988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1dc87324-9155-4a76-a640-11b608912a69 tempest-VolumeDependencyTests-1908634988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1dc87324-9155-4a76-a640-11b608912a69 tempest-VolumeDependencyTests-1908634988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1dc87324-9155-4a76-a640-11b608912a69 tempest-VolumeDependencyTests-1908634988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:33 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:30:33 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:34 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1dc87324-9155-4a76-a640-11b608912a69 tempest-VolumeDependencyTests-1908634988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.241s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:34 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-1dc87324-9155-4a76-a640-11b608912a69 tempest-VolumeDependencyTests-1908634988 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:30:34 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-1dc87324-9155-4a76-a640-11b608912a69 tempest-VolumeDependencyTests-1908634988 None] Deleted volume successfully. Sep 09 18:30:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1dc87324-9155-4a76-a640-11b608912a69 tempest-VolumeDependencyTests-1908634988 None] Lock "cinder-d9615f37-164c-4386-8d40-3ad95aa7bf8e-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a6b41e80-5133-45b5-9e9b-39ae16f1c526 tempest-VolumeDependencyTests-1908634988 None] Acquiring lock "cinder-9f679af7-1ba1-4302-b1b4-ee10d1ac8210-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a6b41e80-5133-45b5-9e9b-39ae16f1c526 tempest-VolumeDependencyTests-1908634988 None] Lock "cinder-9f679af7-1ba1-4302-b1b4-ee10d1ac8210-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a6b41e80-5133-45b5-9e9b-39ae16f1c526 tempest-VolumeDependencyTests-1908634988 None] Acquiring lock "cinder-quobyte-9f679af7-1ba1-4302-b1b4-ee10d1ac8210" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a6b41e80-5133-45b5-9e9b-39ae16f1c526 tempest-VolumeDependencyTests-1908634988 None] Lock "cinder-quobyte-9f679af7-1ba1-4302-b1b4-ee10d1ac8210" acquired by "delete_volume" :: waited 0.015s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:34 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fca04f-6277-474f-8ac3-87c13df40295]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:30:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a6b41e80-5133-45b5-9e9b-39ae16f1c526 tempest-VolumeDependencyTests-1908634988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f679af7-1ba1-4302-b1b4-ee10d1ac8210 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:34 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f679af7-1ba1-4302-b1b4-ee10d1ac8210 Sep 09 18:30:34 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:34 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a6b41e80-5133-45b5-9e9b-39ae16f1c526 tempest-VolumeDependencyTests-1908634988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f679af7-1ba1-4302-b1b4-ee10d1ac8210" returned: 0 in 0.352s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a6b41e80-5133-45b5-9e9b-39ae16f1c526 tempest-VolumeDependencyTests-1908634988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f679af7-1ba1-4302-b1b4-ee10d1ac8210 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:34 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f679af7-1ba1-4302-b1b4-ee10d1ac8210 Sep 09 18:30:34 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:34 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a6b41e80-5133-45b5-9e9b-39ae16f1c526 tempest-VolumeDependencyTests-1908634988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f679af7-1ba1-4302-b1b4-ee10d1ac8210" returned: 0 in 0.245s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a6b41e80-5133-45b5-9e9b-39ae16f1c526 tempest-VolumeDependencyTests-1908634988 None] Lock "cinder-quobyte-9f679af7-1ba1-4302-b1b4-ee10d1ac8210" released by "delete_volume" :: held 0.634s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:34 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-a6b41e80-5133-45b5-9e9b-39ae16f1c526 tempest-VolumeDependencyTests-1908634988 None] Created reservations ['7e72c0c6-31ad-4d10-9dbe-7b480d10ad91', '9aeb3042-7829-44b5-acd5-49212a102a95', 'c4e82d74-6275-4bdf-9f47-2b5366ac2bcd', 'e3313f6f-f8f5-4be5-b9dd-d30c633e5e15'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:30:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a6b41e80-5133-45b5-9e9b-39ae16f1c526 tempest-VolumeDependencyTests-1908634988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a6b41e80-5133-45b5-9e9b-39ae16f1c526 tempest-VolumeDependencyTests-1908634988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a6b41e80-5133-45b5-9e9b-39ae16f1c526 tempest-VolumeDependencyTests-1908634988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:34 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a6b41e80-5133-45b5-9e9b-39ae16f1c526 tempest-VolumeDependencyTests-1908634988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a6b41e80-5133-45b5-9e9b-39ae16f1c526 tempest-VolumeDependencyTests-1908634988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a6b41e80-5133-45b5-9e9b-39ae16f1c526 tempest-VolumeDependencyTests-1908634988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:34 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:30:34 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:35 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a6b41e80-5133-45b5-9e9b-39ae16f1c526 tempest-VolumeDependencyTests-1908634988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.238s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:35 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-a6b41e80-5133-45b5-9e9b-39ae16f1c526 tempest-VolumeDependencyTests-1908634988 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:30:35 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-a6b41e80-5133-45b5-9e9b-39ae16f1c526 tempest-VolumeDependencyTests-1908634988 None] Deleted volume successfully. Sep 09 18:30:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a6b41e80-5133-45b5-9e9b-39ae16f1c526 tempest-VolumeDependencyTests-1908634988 None] Lock "cinder-9f679af7-1ba1-4302-b1b4-ee10d1ac8210-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:42 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:30:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Flow 'volume_create_manager' (406ebe11-f1b9-40d6-9d6c-ff8d2b217883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c60456-abd8-43f3-8cb0-4892acbfda17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50c60456-abd8-43f3-8cb0-4892acbfda17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-582019605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc8752fe-691a-4055-b98d-5d0cec15313c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0cc790703843c18dc92b1097a482ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:30:43Z,use_quota=True,user_id='7f45bd0d2fe24586a9a5fd42fb439473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cded74f0-59f8-4959-b2dc-fc7f9defe686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cded74f0-59f8-4959-b2dc-fc7f9defe686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f238c8cb-2984-4d1f-b114-4beef122d715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f238c8cb-2984-4d1f-b114-4beef122d715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc8752fe-691a-4055-b98d-5d0cec15313c', 'volume_name': 'volume-dc8752fe-691a-4055-b98d-5d0cec15313c', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b08df13-314b-42d6-9119-4a34286c17cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b08df13-314b-42d6-9119-4a34286c17cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3105cc3a-0b4b-41aa-be6c-29e5886f9f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:42 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Volume dc8752fe-691a-4055-b98d-5d0cec15313c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc8752fe-691a-4055-b98d-5d0cec15313c', 'volume_size': 1} Sep 09 18:30:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-582019605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc8752fe-691a-4055-b98d-5d0cec15313c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0cc790703843c18dc92b1097a482ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:30:43Z,use_quota=True,user_id='7f45bd0d2fe24586a9a5fd42fb439473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:30:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Creating volume dc8752fe-691a-4055-b98d-5d0cec15313c {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:30:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:30:42 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:30:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc8752fe-691a-4055-b98d-5d0cec15313c 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:42 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc8752fe-691a-4055-b98d-5d0cec15313c 1073741824 Sep 09 18:30:42 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:43 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc8752fe-691a-4055-b98d-5d0cec15313c 1073741824" returned: 0 in 0.397s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:43 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:30:43 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc8752fe-691a-4055-b98d-5d0cec15313c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:43 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc8752fe-691a-4055-b98d-5d0cec15313c Sep 09 18:30:43 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:43 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.238s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 29 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:30:43 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc8752fe-691a-4055-b98d-5d0cec15313c" returned: 0 in 0.271s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3105cc3a-0b4b-41aa-be6c-29e5886f9f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc8752fe-691a-4055-b98d-5d0cec15313c', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3fc5390-f070-4db2-9038-4cb39869615f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:43 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Volume volume-dc8752fe-691a-4055-b98d-5d0cec15313c (dc8752fe-691a-4055-b98d-5d0cec15313c): created successfully Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3fc5390-f070-4db2-9038-4cb39869615f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Flow 'volume_create_manager' (406ebe11-f1b9-40d6-9d6c-ff8d2b217883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:43 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ade8a6bb-73a9-4545-82fe-fc25054f061e tempest-ProjectReaderTests-1479134288 None] Created volume successfully. Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d0e384b0-2d8f-4249-bb29-00da3efd970b tempest-ProjectReaderTests-1479134288 None] Acquiring lock "cinder-dc8752fe-691a-4055-b98d-5d0cec15313c-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d0e384b0-2d8f-4249-bb29-00da3efd970b tempest-ProjectReaderTests-1479134288 None] Lock "cinder-dc8752fe-691a-4055-b98d-5d0cec15313c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:43 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d0e384b0-2d8f-4249-bb29-00da3efd970b tempest-ProjectReaderTests-1479134288 None] Acquiring lock "cinder-quobyte-dc8752fe-691a-4055-b98d-5d0cec15313c" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d0e384b0-2d8f-4249-bb29-00da3efd970b tempest-ProjectReaderTests-1479134288 None] Lock "cinder-quobyte-dc8752fe-691a-4055-b98d-5d0cec15313c" acquired by "delete_volume" :: waited 0.014s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:44 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1307bb8-5b18-45a8-9c68-7891bece8f5c]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:30:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d0e384b0-2d8f-4249-bb29-00da3efd970b tempest-ProjectReaderTests-1479134288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc8752fe-691a-4055-b98d-5d0cec15313c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:44 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc8752fe-691a-4055-b98d-5d0cec15313c Sep 09 18:30:44 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:44 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d0e384b0-2d8f-4249-bb29-00da3efd970b tempest-ProjectReaderTests-1479134288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc8752fe-691a-4055-b98d-5d0cec15313c" returned: 0 in 0.352s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d0e384b0-2d8f-4249-bb29-00da3efd970b tempest-ProjectReaderTests-1479134288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc8752fe-691a-4055-b98d-5d0cec15313c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:44 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc8752fe-691a-4055-b98d-5d0cec15313c Sep 09 18:30:44 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:44 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d0e384b0-2d8f-4249-bb29-00da3efd970b tempest-ProjectReaderTests-1479134288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-dc8752fe-691a-4055-b98d-5d0cec15313c" returned: 0 in 0.237s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d0e384b0-2d8f-4249-bb29-00da3efd970b tempest-ProjectReaderTests-1479134288 None] Lock "cinder-quobyte-dc8752fe-691a-4055-b98d-5d0cec15313c" released by "delete_volume" :: held 0.627s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:44 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-d0e384b0-2d8f-4249-bb29-00da3efd970b tempest-ProjectReaderTests-1479134288 None] Created reservations ['25386ce3-4f9a-43dc-8884-3b68df3d989e', '307ad528-7c0d-490f-b776-07375de8afaa', 'a4d9588a-83cc-40e9-b418-d65faf06920c', 'e25b5c0e-5f9b-4212-8b35-8bdaacf876af'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:30:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d0e384b0-2d8f-4249-bb29-00da3efd970b tempest-ProjectReaderTests-1479134288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d0e384b0-2d8f-4249-bb29-00da3efd970b tempest-ProjectReaderTests-1479134288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:44 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d0e384b0-2d8f-4249-bb29-00da3efd970b tempest-ProjectReaderTests-1479134288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:44 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d0e384b0-2d8f-4249-bb29-00da3efd970b tempest-ProjectReaderTests-1479134288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d0e384b0-2d8f-4249-bb29-00da3efd970b tempest-ProjectReaderTests-1479134288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d0e384b0-2d8f-4249-bb29-00da3efd970b tempest-ProjectReaderTests-1479134288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:44 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:30:44 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:44 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d0e384b0-2d8f-4249-bb29-00da3efd970b tempest-ProjectReaderTests-1479134288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.237s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:44 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-d0e384b0-2d8f-4249-bb29-00da3efd970b tempest-ProjectReaderTests-1479134288 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:30:44 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d0e384b0-2d8f-4249-bb29-00da3efd970b tempest-ProjectReaderTests-1479134288 None] Deleted volume successfully. Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d0e384b0-2d8f-4249-bb29-00da3efd970b tempest-ProjectReaderTests-1479134288 None] Lock "cinder-dc8752fe-691a-4055-b98d-5d0cec15313c-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Flow 'volume_create_manager' (0b09d34b-bfeb-4c55-98cf-66c5740f43f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89df976a-d16a-4441-94a4-7e5d8e73d5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89df976a-d16a-4441-94a4-7e5d8e73d5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-624783369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1567878d-d227-44e4-96aa-1fd85344c739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0cc790703843c18dc92b1097a482ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:30:45Z,use_quota=True,user_id='7f45bd0d2fe24586a9a5fd42fb439473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cefc9b95-9016-4f45-a2ee-d281d635f15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cefc9b95-9016-4f45-a2ee-d281d635f15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad53e38b-ca74-4385-aef2-04831476b0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad53e38b-ca74-4385-aef2-04831476b0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1567878d-d227-44e4-96aa-1fd85344c739', 'volume_name': 'volume-1567878d-d227-44e4-96aa-1fd85344c739', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ca22ee-c35e-4de2-8cb5-310244132bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ca22ee-c35e-4de2-8cb5-310244132bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb28ef8b-10a7-4962-b826-303e9e91ad35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:45 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Volume 1567878d-d227-44e4-96aa-1fd85344c739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1567878d-d227-44e4-96aa-1fd85344c739', 'volume_size': 1} Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-624783369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1567878d-d227-44e4-96aa-1fd85344c739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0cc790703843c18dc92b1097a482ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:30:45Z,use_quota=True,user_id='7f45bd0d2fe24586a9a5fd42fb439473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Creating volume 1567878d-d227-44e4-96aa-1fd85344c739 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:30:45 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1567878d-d227-44e4-96aa-1fd85344c739 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:45 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1567878d-d227-44e4-96aa-1fd85344c739 1073741824 Sep 09 18:30:45 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:45 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1567878d-d227-44e4-96aa-1fd85344c739 1073741824" returned: 0 in 0.391s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1567878d-d227-44e4-96aa-1fd85344c739 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:46 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1567878d-d227-44e4-96aa-1fd85344c739 Sep 09 18:30:46 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:46 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1567878d-d227-44e4-96aa-1fd85344c739" returned: 0 in 0.236s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:46 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:30:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb28ef8b-10a7-4962-b826-303e9e91ad35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1567878d-d227-44e4-96aa-1fd85344c739', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2550b12d-51af-4276-a556-6720bd200b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:46 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Volume volume-1567878d-d227-44e4-96aa-1fd85344c739 (1567878d-d227-44e4-96aa-1fd85344c739): created successfully Sep 09 18:30:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2550b12d-51af-4276-a556-6720bd200b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Flow 'volume_create_manager' (0b09d34b-bfeb-4c55-98cf-66c5740f43f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:46 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-629630e6-9503-43cc-999c-f0f3a914d8aa tempest-ProjectReaderTests-1479134288 None] Created volume successfully. Sep 09 18:30:46 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-12abbd96-5bcf-41fa-882e-7b1d338d3b2c tempest-ProjectReaderTests-1479134288 None] Acquiring lock "cinder-1567878d-d227-44e4-96aa-1fd85344c739-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:46 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-12abbd96-5bcf-41fa-882e-7b1d338d3b2c tempest-ProjectReaderTests-1479134288 None] Lock "cinder-1567878d-d227-44e4-96aa-1fd85344c739-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:46 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-12abbd96-5bcf-41fa-882e-7b1d338d3b2c tempest-ProjectReaderTests-1479134288 None] Acquiring lock "cinder-quobyte-1567878d-d227-44e4-96aa-1fd85344c739" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:46 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-12abbd96-5bcf-41fa-882e-7b1d338d3b2c tempest-ProjectReaderTests-1479134288 None] Lock "cinder-quobyte-1567878d-d227-44e4-96aa-1fd85344c739" acquired by "delete_volume" :: waited 0.014s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:46 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bfee08-c820-485d-a518-2083b3d38771]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:30:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-12abbd96-5bcf-41fa-882e-7b1d338d3b2c tempest-ProjectReaderTests-1479134288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1567878d-d227-44e4-96aa-1fd85344c739 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:46 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1567878d-d227-44e4-96aa-1fd85344c739 Sep 09 18:30:46 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:46 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-12abbd96-5bcf-41fa-882e-7b1d338d3b2c tempest-ProjectReaderTests-1479134288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1567878d-d227-44e4-96aa-1fd85344c739" returned: 0 in 0.352s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-12abbd96-5bcf-41fa-882e-7b1d338d3b2c tempest-ProjectReaderTests-1479134288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1567878d-d227-44e4-96aa-1fd85344c739 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:47 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1567878d-d227-44e4-96aa-1fd85344c739 Sep 09 18:30:47 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:47 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-12abbd96-5bcf-41fa-882e-7b1d338d3b2c tempest-ProjectReaderTests-1479134288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1567878d-d227-44e4-96aa-1fd85344c739" returned: 0 in 0.239s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:47 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-12abbd96-5bcf-41fa-882e-7b1d338d3b2c tempest-ProjectReaderTests-1479134288 None] Lock "cinder-quobyte-1567878d-d227-44e4-96aa-1fd85344c739" released by "delete_volume" :: held 0.626s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:47 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-12abbd96-5bcf-41fa-882e-7b1d338d3b2c tempest-ProjectReaderTests-1479134288 None] Created reservations ['708fa425-5716-4e7c-9e3c-67849a479672', '5b06501b-592b-41ef-8193-d1fc41fb373c', '1fc9d525-37c3-4f14-a2fe-825bf7987a7e', '445d0614-9e08-4e75-a94f-07183af82f64'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:30:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-12abbd96-5bcf-41fa-882e-7b1d338d3b2c tempest-ProjectReaderTests-1479134288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-12abbd96-5bcf-41fa-882e-7b1d338d3b2c tempest-ProjectReaderTests-1479134288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-12abbd96-5bcf-41fa-882e-7b1d338d3b2c tempest-ProjectReaderTests-1479134288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-12abbd96-5bcf-41fa-882e-7b1d338d3b2c tempest-ProjectReaderTests-1479134288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-12abbd96-5bcf-41fa-882e-7b1d338d3b2c tempest-ProjectReaderTests-1479134288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-12abbd96-5bcf-41fa-882e-7b1d338d3b2c tempest-ProjectReaderTests-1479134288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:47 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:30:47 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:47 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-12abbd96-5bcf-41fa-882e-7b1d338d3b2c tempest-ProjectReaderTests-1479134288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.243s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:47 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-12abbd96-5bcf-41fa-882e-7b1d338d3b2c tempest-ProjectReaderTests-1479134288 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:30:47 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-12abbd96-5bcf-41fa-882e-7b1d338d3b2c tempest-ProjectReaderTests-1479134288 None] Deleted volume successfully. Sep 09 18:30:47 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-12abbd96-5bcf-41fa-882e-7b1d338d3b2c tempest-ProjectReaderTests-1479134288 None] Lock "cinder-1567878d-d227-44e4-96aa-1fd85344c739-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Flow 'volume_create_manager' (9b38f49e-86f0-4b00-9a54-1a7e5eb9a4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5dd9ae-5ec1-4b9c-a975-4bb0fcac7828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f5dd9ae-5ec1-4b9c-a975-4bb0fcac7828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-564907240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551e9131-b299-40d2-b504-680ef08d71c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0cc790703843c18dc92b1097a482ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:30:48Z,use_quota=True,user_id='7f45bd0d2fe24586a9a5fd42fb439473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd79e63-f00a-4e32-bc61-dd437ef2ef71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd79e63-f00a-4e32-bc61-dd437ef2ef71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019acf83-7121-44e2-b1a0-7ab80c3675ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (019acf83-7121-44e2-b1a0-7ab80c3675ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '551e9131-b299-40d2-b504-680ef08d71c0', 'volume_name': 'volume-551e9131-b299-40d2-b504-680ef08d71c0', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58520aa-dcca-45a6-ab62-a79320f2e1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58520aa-dcca-45a6-ab62-a79320f2e1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa32c04d-c79a-41a8-84d1-421a5ad3af26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:48 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Volume 551e9131-b299-40d2-b504-680ef08d71c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-551e9131-b299-40d2-b504-680ef08d71c0', 'volume_size': 1} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-564907240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=551e9131-b299-40d2-b504-680ef08d71c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0cc790703843c18dc92b1097a482ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:30:48Z,use_quota=True,user_id='7f45bd0d2fe24586a9a5fd42fb439473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Creating volume 551e9131-b299-40d2-b504-680ef08d71c0 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:30:48 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-551e9131-b299-40d2-b504-680ef08d71c0 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:48 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-551e9131-b299-40d2-b504-680ef08d71c0 1073741824 Sep 09 18:30:48 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:48 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-551e9131-b299-40d2-b504-680ef08d71c0 1073741824" returned: 0 in 0.401s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-551e9131-b299-40d2-b504-680ef08d71c0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:48 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-551e9131-b299-40d2-b504-680ef08d71c0 Sep 09 18:30:48 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:48 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-551e9131-b299-40d2-b504-680ef08d71c0" returned: 0 in 0.245s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa32c04d-c79a-41a8-84d1-421a5ad3af26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-551e9131-b299-40d2-b504-680ef08d71c0', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0661e8da-4a99-462f-afb8-173dc94f9f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:48 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Volume volume-551e9131-b299-40d2-b504-680ef08d71c0 (551e9131-b299-40d2-b504-680ef08d71c0): created successfully Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0661e8da-4a99-462f-afb8-173dc94f9f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Flow 'volume_create_manager' (9b38f49e-86f0-4b00-9a54-1a7e5eb9a4ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:48 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-6dea4e9e-2774-4e54-89db-f5cf7f5a4885 tempest-ProjectReaderTests-1479134288 None] Created volume successfully. Sep 09 18:30:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5792dd3f-c907-4ec3-9370-e64a577472fa tempest-ProjectReaderTests-1479134288 None] Acquiring lock "cinder-551e9131-b299-40d2-b504-680ef08d71c0-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5792dd3f-c907-4ec3-9370-e64a577472fa tempest-ProjectReaderTests-1479134288 None] Lock "cinder-551e9131-b299-40d2-b504-680ef08d71c0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5792dd3f-c907-4ec3-9370-e64a577472fa tempest-ProjectReaderTests-1479134288 None] Acquiring lock "cinder-quobyte-551e9131-b299-40d2-b504-680ef08d71c0" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5792dd3f-c907-4ec3-9370-e64a577472fa tempest-ProjectReaderTests-1479134288 None] Lock "cinder-quobyte-551e9131-b299-40d2-b504-680ef08d71c0" acquired by "delete_volume" :: waited 0.015s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:49 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d4bb90-b4a1-4d2b-bec2-da51097e4ca0]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:30:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5792dd3f-c907-4ec3-9370-e64a577472fa tempest-ProjectReaderTests-1479134288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-551e9131-b299-40d2-b504-680ef08d71c0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:49 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-551e9131-b299-40d2-b504-680ef08d71c0 Sep 09 18:30:49 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:49 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5792dd3f-c907-4ec3-9370-e64a577472fa tempest-ProjectReaderTests-1479134288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-551e9131-b299-40d2-b504-680ef08d71c0" returned: 0 in 0.351s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5792dd3f-c907-4ec3-9370-e64a577472fa tempest-ProjectReaderTests-1479134288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-551e9131-b299-40d2-b504-680ef08d71c0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:49 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-551e9131-b299-40d2-b504-680ef08d71c0 Sep 09 18:30:49 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:49 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5792dd3f-c907-4ec3-9370-e64a577472fa tempest-ProjectReaderTests-1479134288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-551e9131-b299-40d2-b504-680ef08d71c0" returned: 0 in 0.248s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5792dd3f-c907-4ec3-9370-e64a577472fa tempest-ProjectReaderTests-1479134288 None] Lock "cinder-quobyte-551e9131-b299-40d2-b504-680ef08d71c0" released by "delete_volume" :: held 0.634s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:49 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-5792dd3f-c907-4ec3-9370-e64a577472fa tempest-ProjectReaderTests-1479134288 None] Created reservations ['b1f05521-3dec-44e4-9aa8-4d9db0ee493d', 'e11ebe4b-cb23-40eb-81cd-0a8aaa5c00e1', '4ccfebb6-de02-4ac6-8242-7dda6fb6ffb6', '62a3d342-1a14-4df9-bdba-ef361044a83a'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:30:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5792dd3f-c907-4ec3-9370-e64a577472fa tempest-ProjectReaderTests-1479134288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5792dd3f-c907-4ec3-9370-e64a577472fa tempest-ProjectReaderTests-1479134288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:49 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5792dd3f-c907-4ec3-9370-e64a577472fa tempest-ProjectReaderTests-1479134288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5792dd3f-c907-4ec3-9370-e64a577472fa tempest-ProjectReaderTests-1479134288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5792dd3f-c907-4ec3-9370-e64a577472fa tempest-ProjectReaderTests-1479134288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5792dd3f-c907-4ec3-9370-e64a577472fa tempest-ProjectReaderTests-1479134288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:50 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:30:50 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:50 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5792dd3f-c907-4ec3-9370-e64a577472fa tempest-ProjectReaderTests-1479134288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.238s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-5792dd3f-c907-4ec3-9370-e64a577472fa tempest-ProjectReaderTests-1479134288 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:30:50 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-5792dd3f-c907-4ec3-9370-e64a577472fa tempest-ProjectReaderTests-1479134288 None] Deleted volume successfully. Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5792dd3f-c907-4ec3-9370-e64a577472fa tempest-ProjectReaderTests-1479134288 None] Lock "cinder-551e9131-b299-40d2-b504-680ef08d71c0-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Flow 'volume_create_manager' (75135bae-c030-4900-bea8-ec04e04dced3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba6ee30-8449-45a7-ada4-dd29e49923c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba6ee30-8449-45a7-ada4-dd29e49923c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-637364234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7825e17e-f91b-41c4-8dbd-98652dcbc488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0cc790703843c18dc92b1097a482ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:30:51Z,use_quota=True,user_id='7f45bd0d2fe24586a9a5fd42fb439473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b07d18-f368-45ff-befe-bc3f442a0f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b07d18-f368-45ff-befe-bc3f442a0f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c745f772-1561-4570-935d-f4c980a313f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c745f772-1561-4570-935d-f4c980a313f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7825e17e-f91b-41c4-8dbd-98652dcbc488', 'volume_name': 'volume-7825e17e-f91b-41c4-8dbd-98652dcbc488', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48875f67-db57-45dc-a8a8-58233d3f13ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48875f67-db57-45dc-a8a8-58233d3f13ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13db64a5-1498-4d91-b6a0-a1f0877c846f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:50 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Volume 7825e17e-f91b-41c4-8dbd-98652dcbc488: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7825e17e-f91b-41c4-8dbd-98652dcbc488', 'volume_size': 1} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-637364234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7825e17e-f91b-41c4-8dbd-98652dcbc488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d0cc790703843c18dc92b1097a482ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:30:51Z,use_quota=True,user_id='7f45bd0d2fe24586a9a5fd42fb439473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Creating volume 7825e17e-f91b-41c4-8dbd-98652dcbc488 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:30:50 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:30:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7825e17e-f91b-41c4-8dbd-98652dcbc488 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:50 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7825e17e-f91b-41c4-8dbd-98652dcbc488 1073741824 Sep 09 18:30:50 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:51 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7825e17e-f91b-41c4-8dbd-98652dcbc488 1073741824" returned: 0 in 0.399s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7825e17e-f91b-41c4-8dbd-98652dcbc488 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:51 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7825e17e-f91b-41c4-8dbd-98652dcbc488 Sep 09 18:30:51 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:51 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7825e17e-f91b-41c4-8dbd-98652dcbc488" returned: 0 in 0.248s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:30:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13db64a5-1498-4d91-b6a0-a1f0877c846f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7825e17e-f91b-41c4-8dbd-98652dcbc488', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c7d12f-7f0b-45cc-8b7a-dc1ccd8fb68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:30:51 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Volume volume-7825e17e-f91b-41c4-8dbd-98652dcbc488 (7825e17e-f91b-41c4-8dbd-98652dcbc488): created successfully Sep 09 18:30:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c7d12f-7f0b-45cc-8b7a-dc1ccd8fb68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:30:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Flow 'volume_create_manager' (75135bae-c030-4900-bea8-ec04e04dced3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:30:51 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ba97eca3-e236-4e16-b7df-b942c26085ad tempest-ProjectReaderTests-1479134288 None] Created volume successfully. Sep 09 18:30:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-09d324ca-3206-4e98-992f-154cc10122a8 tempest-ProjectReaderTests-1479134288 None] Acquiring lock "cinder-7825e17e-f91b-41c4-8dbd-98652dcbc488-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-09d324ca-3206-4e98-992f-154cc10122a8 tempest-ProjectReaderTests-1479134288 None] Lock "cinder-7825e17e-f91b-41c4-8dbd-98652dcbc488-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-09d324ca-3206-4e98-992f-154cc10122a8 tempest-ProjectReaderTests-1479134288 None] Acquiring lock "cinder-quobyte-7825e17e-f91b-41c4-8dbd-98652dcbc488" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:30:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-09d324ca-3206-4e98-992f-154cc10122a8 tempest-ProjectReaderTests-1479134288 None] Lock "cinder-quobyte-7825e17e-f91b-41c4-8dbd-98652dcbc488" acquired by "delete_volume" :: waited 0.015s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:30:51 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[7004d3b7-5723-40aa-adf0-0e57e85ed045]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:30:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-09d324ca-3206-4e98-992f-154cc10122a8 tempest-ProjectReaderTests-1479134288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7825e17e-f91b-41c4-8dbd-98652dcbc488 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:51 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7825e17e-f91b-41c4-8dbd-98652dcbc488 Sep 09 18:30:51 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:52 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-09d324ca-3206-4e98-992f-154cc10122a8 tempest-ProjectReaderTests-1479134288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7825e17e-f91b-41c4-8dbd-98652dcbc488" returned: 0 in 0.357s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-09d324ca-3206-4e98-992f-154cc10122a8 tempest-ProjectReaderTests-1479134288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7825e17e-f91b-41c4-8dbd-98652dcbc488 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:52 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7825e17e-f91b-41c4-8dbd-98652dcbc488 Sep 09 18:30:52 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:52 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-09d324ca-3206-4e98-992f-154cc10122a8 tempest-ProjectReaderTests-1479134288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7825e17e-f91b-41c4-8dbd-98652dcbc488" returned: 0 in 0.238s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:52 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-09d324ca-3206-4e98-992f-154cc10122a8 tempest-ProjectReaderTests-1479134288 None] Lock "cinder-quobyte-7825e17e-f91b-41c4-8dbd-98652dcbc488" released by "delete_volume" :: held 0.633s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:30:52 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-09d324ca-3206-4e98-992f-154cc10122a8 tempest-ProjectReaderTests-1479134288 None] Created reservations ['2f772573-ede8-4b1b-8469-a524016c1d67', '9b220767-5e8b-4674-82ca-ae824b7eb2a2', '9fbf8a3e-76d7-4e57-9c05-45d43f5355a7', '61fef6d0-c30c-4f98-a87f-7f501eb51df3'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:30:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-09d324ca-3206-4e98-992f-154cc10122a8 tempest-ProjectReaderTests-1479134288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:30:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-09d324ca-3206-4e98-992f-154cc10122a8 tempest-ProjectReaderTests-1479134288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:30:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-09d324ca-3206-4e98-992f-154cc10122a8 tempest-ProjectReaderTests-1479134288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:30:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-09d324ca-3206-4e98-992f-154cc10122a8 tempest-ProjectReaderTests-1479134288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:30:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-09d324ca-3206-4e98-992f-154cc10122a8 tempest-ProjectReaderTests-1479134288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:30:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-09d324ca-3206-4e98-992f-154cc10122a8 tempest-ProjectReaderTests-1479134288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:30:52 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:30:52 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:30:52 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Sep 09 18:30:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-09d324ca-3206-4e98-992f-154cc10122a8 tempest-ProjectReaderTests-1479134288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.249s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:30:52 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-09d324ca-3206-4e98-992f-154cc10122a8 tempest-ProjectReaderTests-1479134288 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:30:52 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-09d324ca-3206-4e98-992f-154cc10122a8 tempest-ProjectReaderTests-1479134288 None] Deleted volume successfully. Sep 09 18:30:52 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=104,cinder:UPDATE=145,cinder:INSERT=41,cinder:DELETE=11 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:30:52 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-09d324ca-3206-4e98-992f-154cc10122a8 tempest-ProjectReaderTests-1479134288 None] Lock "cinder-7825e17e-f91b-41c4-8dbd-98652dcbc488-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:31:02 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:UPDATE=137,cinder:SELECT=98,cinder:INSERT=34,cinder:DELETE=14 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Flow 'volume_create_manager' (3f6afbde-cc5c-4ec2-b051-9fd835c1cc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeedf417-5a0d-4473-80da-a8c05660b269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeedf417-5a0d-4473-80da-a8c05660b269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-758993841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3747c0-bbc1-427b-a671-1b89af1c96a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21070f07bdc747fbadfbce4c2a41f92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:31:12Z,use_quota=True,user_id='b7380ed44c254506a9da7d87af4491c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16675de-5634-474a-86a0-572172958ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16675de-5634-474a-86a0-572172958ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ee3190-a211-4430-b1d7-7946c0310bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86ee3190-a211-4430-b1d7-7946c0310bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be3747c0-bbc1-427b-a671-1b89af1c96a4', 'volume_name': 'volume-be3747c0-bbc1-427b-a671-1b89af1c96a4', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17942226-bc5e-435a-96a8-11587ff2f85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17942226-bc5e-435a-96a8-11587ff2f85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299ab6b5-2288-40c4-adbf-8dafd71ea165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:12 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Volume be3747c0-bbc1-427b-a671-1b89af1c96a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be3747c0-bbc1-427b-a671-1b89af1c96a4', 'volume_size': 1} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:31:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-758993841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3747c0-bbc1-427b-a671-1b89af1c96a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21070f07bdc747fbadfbce4c2a41f92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:31:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:31:12Z,use_quota=True,user_id='b7380ed44c254506a9da7d87af4491c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Creating volume be3747c0-bbc1-427b-a671-1b89af1c96a4 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:31:12 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:12 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 1073741824 Sep 09 18:31:12 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:12 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 1073741824" returned: 0 in 0.387s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:12 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 Sep 09 18:31:12 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:12 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4" returned: 0 in 0.235s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] <== create_volume: return (661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299ab6b5-2288-40c4-adbf-8dafd71ea165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be3747c0-bbc1-427b-a671-1b89af1c96a4', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41776890-6d0d-4b62-b38d-232bb0940c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:13 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Volume volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 (be3747c0-bbc1-427b-a671-1b89af1c96a4): created successfully Sep 09 18:31:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41776890-6d0d-4b62-b38d-232bb0940c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Flow 'volume_create_manager' (3f6afbde-cc5c-4ec2-b051-9fd835c1cc80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:31:13 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-de57fa9d-680d-4fb3-acbe-a81f5b8df512 tempest-SnapshotDependencyTests-374637800 None] Created volume successfully. Sep 09 18:31:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-32ce64c6-a477-4fb6-92d8-57613900b00e tempest-SnapshotDependencyTests-374637800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-32ce64c6-a477-4fb6-92d8-57613900b00e tempest-SnapshotDependencyTests-374637800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-32ce64c6-a477-4fb6-92d8-57613900b00e tempest-SnapshotDependencyTests-374637800 None] Creating offline snapshot a3d59430-ed5b-4a67-b850-d5012487f53e of volume be3747c0-bbc1-427b-a671-1b89af1c96a4 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:31:13 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef554090-a7ce-4623-b73a-2e8e7c96af02]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:31:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-32ce64c6-a477-4fb6-92d8-57613900b00e tempest-SnapshotDependencyTests-374637800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:13 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 Sep 09 18:31:13 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:13 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-32ce64c6-a477-4fb6-92d8-57613900b00e tempest-SnapshotDependencyTests-374637800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4" returned: 0 in 0.351s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-32ce64c6-a477-4fb6-92d8-57613900b00e tempest-SnapshotDependencyTests-374637800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:13 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e 1G Sep 09 18:31:13 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:14 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-32ce64c6-a477-4fb6-92d8-57613900b00e tempest-SnapshotDependencyTests-374637800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e 1G" returned: 0 in 0.375s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-32ce64c6-a477-4fb6-92d8-57613900b00e tempest-SnapshotDependencyTests-374637800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:14 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e Sep 09 18:31:14 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:14 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-32ce64c6-a477-4fb6-92d8-57613900b00e tempest-SnapshotDependencyTests-374637800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e" returned: 0 in 0.285s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:14 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-32ce64c6-a477-4fb6-92d8-57613900b00e tempest-SnapshotDependencyTests-374637800 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e is being set with open permissions: ugo+rw Sep 09 18:31:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-32ce64c6-a477-4fb6-92d8-57613900b00e tempest-SnapshotDependencyTests-374637800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:14 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e Sep 09 18:31:14 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:14 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-32ce64c6-a477-4fb6-92d8-57613900b00e tempest-SnapshotDependencyTests-374637800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e" returned: 0 in 0.235s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-32ce64c6-a477-4fb6-92d8-57613900b00e tempest-SnapshotDependencyTests-374637800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:14 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.info Sep 09 18:31:14 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:15 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-32ce64c6-a477-4fb6-92d8-57613900b00e tempest-SnapshotDependencyTests-374637800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.info" returned: 0 in 0.250s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:15 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-32ce64c6-a477-4fb6-92d8-57613900b00e tempest-SnapshotDependencyTests-374637800 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.info is being set with open permissions: ugo+rw Sep 09 18:31:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-32ce64c6-a477-4fb6-92d8-57613900b00e tempest-SnapshotDependencyTests-374637800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:15 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.info Sep 09 18:31:15 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:15 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-32ce64c6-a477-4fb6-92d8-57613900b00e tempest-SnapshotDependencyTests-374637800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.info" returned: 0 in 0.236s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-32ce64c6-a477-4fb6-92d8-57613900b00e tempest-SnapshotDependencyTests-374637800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.808s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:15 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-32ce64c6-a477-4fb6-92d8-57613900b00e tempest-SnapshotDependencyTests-374637800 None] Create snapshot completed successfully Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Flow 'volume_create_manager' (8680705f-26f3-4193-abe7-8fcced6ef88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44bffbfe-c061-4978-ac8c-e98dbe72387a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44bffbfe-c061-4978-ac8c-e98dbe72387a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7aea121-8e6d-466c-9e7d-b657ec464c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21070f07bdc747fbadfbce4c2a41f92b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a3d59430-ed5b-4a67-b850-d5012487f53e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:31:16Z,use_quota=True,user_id='b7380ed44c254506a9da7d87af4491c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ecefd9-1762-473e-b5b7-a5e5079acc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9ecefd9-1762-473e-b5b7-a5e5079acc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f727b6b-ae39-42f6-a4fc-1f76e360cc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f727b6b-ae39-42f6-a4fc-1f76e360cc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e7aea121-8e6d-466c-9e7d-b657ec464c39', 'volume_name': 'volume-e7aea121-8e6d-466c-9e7d-b657ec464c39', 'volume_size': 1, 'snapshot_id': 'a3d59430-ed5b-4a67-b850-d5012487f53e'}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afcaf3b-eaf6-4327-b16a-5b2b1f90a927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afcaf3b-eaf6-4327-b16a-5b2b1f90a927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448be7b4-3606-4a01-99ee-e441db64380f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:16 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Volume e7aea121-8e6d-466c-9e7d-b657ec464c39: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e7aea121-8e6d-466c-9e7d-b657ec464c39', 'volume_size': 1, 'snapshot_id': 'a3d59430-ed5b-4a67-b850-d5012487f53e'} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Acquiring lock "cinder-quobyte-a3d59430-ed5b-4a67-b850-d5012487f53e-e7aea121-8e6d-466c-9e7d-b657ec464c39" by "_create_volume_from_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Lock "cinder-quobyte-a3d59430-ed5b-4a67-b850-d5012487f53e-e7aea121-8e6d-466c-9e7d-b657ec464c39" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Creating volume e7aea121-8e6d-466c-9e7d-b657ec464c39 from snapshot a3d59430-ed5b-4a67-b850-d5012487f53e {{(pid=87639) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Acquiring lock "cinder-quobyte-e7aea121-8e6d-466c-9e7d-b657ec464c39" by "_copy_volume_from_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Lock "cinder-quobyte-e7aea121-8e6d-466c-9e7d-b657ec464c39" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] snapshot: a3d59430-ed5b-4a67-b850-d5012487f53e, volume: e7aea121-8e6d-466c-9e7d-b657ec464c39, {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf7e8a5-24ab-48e8-8718-4766954b70f3]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:16 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e Sep 09 18:31:16 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:16 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e" returned: 0 in 0.361s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be3747c0-bbc1-427b-a671-1b89af1c96a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8519e41e-bad1-49aa-9863-834b725dea27]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:31:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:16 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 Sep 09 18:31:16 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:17 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4" returned: 0 in 0.351s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 18:31:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Creating direct copy from snapshot {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 18:31:17 devstack cinder-volume[87639]: DEBUG cinder.utils [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Path /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e7aea121-8e6d-466c-9e7d-b657ec464c39 not found in is_blk_device check {{(pid=87639) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 18:31:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e7aea121-8e6d-466c-9e7d-b657ec464c39 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:17 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e7aea121-8e6d-466c-9e7d-b657ec464c39 Sep 09 18:31:17 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:20 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e7aea121-8e6d-466c-9e7d-b657ec464c39" returned: 0 in 3.877s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:20 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Image conversion details: src /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4, size 1024.00 MB, duration 3.88 sec, destination /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e7aea121-8e6d-466c-9e7d-b657ec464c39 {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:31:20 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Converted 1024.00 MB image at 264.00 MB/s Sep 09 18:31:20 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e7aea121-8e6d-466c-9e7d-b657ec464c39 is being set with open permissions: ugo+rw Sep 09 18:31:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e7aea121-8e6d-466c-9e7d-b657ec464c39 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:20 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e7aea121-8e6d-466c-9e7d-b657ec464c39 Sep 09 18:31:20 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:21 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e7aea121-8e6d-466c-9e7d-b657ec464c39" returned: 0 in 0.238s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Lock "cinder-quobyte-e7aea121-8e6d-466c-9e7d-b657ec464c39" released by "_copy_volume_from_snapshot" :: held 4.900s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:31:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Lock "cinder-quobyte-a3d59430-ed5b-4a67-b850-d5012487f53e-e7aea121-8e6d-466c-9e7d-b657ec464c39" released by "_create_volume_from_snapshot" :: held 4.958s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:31:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.973s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448be7b4-3606-4a01-99ee-e441db64380f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7aea121-8e6d-466c-9e7d-b657ec464c39', 'volume_size': 1, 'snapshot_id': 'a3d59430-ed5b-4a67-b850-d5012487f53e'}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39132519-bd5e-4510-880a-389219ad7a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:21 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Volume volume-e7aea121-8e6d-466c-9e7d-b657ec464c39 (e7aea121-8e6d-466c-9e7d-b657ec464c39): created successfully Sep 09 18:31:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39132519-bd5e-4510-880a-389219ad7a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Flow 'volume_create_manager' (8680705f-26f3-4193-abe7-8fcced6ef88e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:31:21 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-f55102d1-f3fa-4229-8991-6dc912320f9b tempest-SnapshotDependencyTests-374637800 None] Created volume successfully. Sep 09 18:31:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7757eac8-1e02-47cf-a852-05476f166d07 tempest-SnapshotDependencyTests-374637800 None] Acquiring lock "cinder-a3d59430-ed5b-4a67-b850-d5012487f53e-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:31:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7757eac8-1e02-47cf-a852-05476f166d07 tempest-SnapshotDependencyTests-374637800 None] Lock "cinder-a3d59430-ed5b-4a67-b850-d5012487f53e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:31:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7757eac8-1e02-47cf-a852-05476f166d07 tempest-SnapshotDependencyTests-374637800 None] Acquiring lock "cinder-quobyte-be3747c0-bbc1-427b-a671-1b89af1c96a4" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:31:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7757eac8-1e02-47cf-a852-05476f166d07 tempest-SnapshotDependencyTests-374637800 None] Lock "cinder-quobyte-be3747c0-bbc1-427b-a671-1b89af1c96a4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:31:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7757eac8-1e02-47cf-a852-05476f166d07 tempest-SnapshotDependencyTests-374637800 None] Acquiring lock "cinder-quobyte-a3d59430-ed5b-4a67-b850-d5012487f53e" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:31:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7757eac8-1e02-47cf-a852-05476f166d07 tempest-SnapshotDependencyTests-374637800 None] Lock "cinder-quobyte-a3d59430-ed5b-4a67-b850-d5012487f53e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:31:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-7757eac8-1e02-47cf-a852-05476f166d07 tempest-SnapshotDependencyTests-374637800 None] Deleting offline snapshot a3d59430-ed5b-4a67-b850-d5012487f53e of volume be3747c0-bbc1-427b-a671-1b89af1c96a4 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:31:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-7757eac8-1e02-47cf-a852-05476f166d07 tempest-SnapshotDependencyTests-374637800 None] snapshot_file for this snap is: volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:31:21 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[064e0141-76ae-4a43-bdcc-e5538700e947]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:31:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7757eac8-1e02-47cf-a852-05476f166d07 tempest-SnapshotDependencyTests-374637800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:21 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e Sep 09 18:31:21 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:22 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7757eac8-1e02-47cf-a852-05476f166d07 tempest-SnapshotDependencyTests-374637800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e" returned: 0 in 0.339s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-7757eac8-1e02-47cf-a852-05476f166d07 tempest-SnapshotDependencyTests-374637800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be3747c0-bbc1-427b-a671-1b89af1c96a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:31:22 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e583fb17-5f87-4aa9-a43c-82df9374707a]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:31:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7757eac8-1e02-47cf-a852-05476f166d07 tempest-SnapshotDependencyTests-374637800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:22 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 Sep 09 18:31:22 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:22 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7757eac8-1e02-47cf-a852-05476f166d07 tempest-SnapshotDependencyTests-374637800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4" returned: 0 in 0.521s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7757eac8-1e02-47cf-a852-05476f166d07 tempest-SnapshotDependencyTests-374637800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:22 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e Sep 09 18:31:22 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:22 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7757eac8-1e02-47cf-a852-05476f166d07 tempest-SnapshotDependencyTests-374637800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e" returned: 0 in 0.311s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7757eac8-1e02-47cf-a852-05476f166d07 tempest-SnapshotDependencyTests-374637800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:22 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e Sep 09 18:31:22 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:23 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7757eac8-1e02-47cf-a852-05476f166d07 tempest-SnapshotDependencyTests-374637800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4.a3d59430-ed5b-4a67-b850-d5012487f53e" returned: 0 in 0.239s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7757eac8-1e02-47cf-a852-05476f166d07 tempest-SnapshotDependencyTests-374637800 None] Lock "cinder-quobyte-a3d59430-ed5b-4a67-b850-d5012487f53e" released by "_delete_snapshot" :: held 1.495s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:31:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7757eac8-1e02-47cf-a852-05476f166d07 tempest-SnapshotDependencyTests-374637800 None] Lock "cinder-quobyte-be3747c0-bbc1-427b-a671-1b89af1c96a4" released by "delete_snapshot" :: held 1.518s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:31:23 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-7757eac8-1e02-47cf-a852-05476f166d07 tempest-SnapshotDependencyTests-374637800 None] Created reservations ['025ad4d5-e939-44a7-a2c2-52ee8697bc31', 'f8b93eb2-be61-4fc1-9b82-b47c0197f33c', '38f7a407-5d84-447e-8e61-6a4d9d7ace51', '0a60cd57-ddca-4bf6-8adb-6c9569fd155f'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:31:23 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-7757eac8-1e02-47cf-a852-05476f166d07 tempest-SnapshotDependencyTests-374637800 None] Delete snapshot completed successfully. Sep 09 18:31:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7757eac8-1e02-47cf-a852-05476f166d07 tempest-SnapshotDependencyTests-374637800 None] Lock "cinder-a3d59430-ed5b-4a67-b850-d5012487f53e-delete_snapshot" released by "delete_snapshot" :: held 1.639s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:31:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a3f65234-e3a6-4271-9ff1-758ed062486b tempest-SnapshotDependencyTests-374637800 None] Acquiring lock "cinder-be3747c0-bbc1-427b-a671-1b89af1c96a4-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:31:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a3f65234-e3a6-4271-9ff1-758ed062486b tempest-SnapshotDependencyTests-374637800 None] Lock "cinder-be3747c0-bbc1-427b-a671-1b89af1c96a4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:31:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a3f65234-e3a6-4271-9ff1-758ed062486b tempest-SnapshotDependencyTests-374637800 None] Acquiring lock "cinder-quobyte-be3747c0-bbc1-427b-a671-1b89af1c96a4" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:31:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a3f65234-e3a6-4271-9ff1-758ed062486b tempest-SnapshotDependencyTests-374637800 None] Lock "cinder-quobyte-be3747c0-bbc1-427b-a671-1b89af1c96a4" acquired by "delete_volume" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:31:23 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fd7fea-e19f-46f8-9614-ac6c92692eb5]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:31:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a3f65234-e3a6-4271-9ff1-758ed062486b tempest-SnapshotDependencyTests-374637800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:24 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 Sep 09 18:31:24 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:24 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a3f65234-e3a6-4271-9ff1-758ed062486b tempest-SnapshotDependencyTests-374637800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4" returned: 0 in 0.341s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a3f65234-e3a6-4271-9ff1-758ed062486b tempest-SnapshotDependencyTests-374637800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:24 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4 Sep 09 18:31:24 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:24 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a3f65234-e3a6-4271-9ff1-758ed062486b tempest-SnapshotDependencyTests-374637800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-be3747c0-bbc1-427b-a671-1b89af1c96a4" returned: 0 in 0.235s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:24 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a3f65234-e3a6-4271-9ff1-758ed062486b tempest-SnapshotDependencyTests-374637800 None] Lock "cinder-quobyte-be3747c0-bbc1-427b-a671-1b89af1c96a4" released by "delete_volume" :: held 0.623s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:31:24 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-a3f65234-e3a6-4271-9ff1-758ed062486b tempest-SnapshotDependencyTests-374637800 None] Created reservations ['5b6bd03e-471f-4384-ac00-49f8dceb362a', '82814707-a874-4eac-b14e-db749dd65fcd', '2724d317-5c1c-4f43-a298-e6696139280b', '4fdfb577-536b-49fb-9df3-09214a524667'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:31:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a3f65234-e3a6-4271-9ff1-758ed062486b tempest-SnapshotDependencyTests-374637800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a3f65234-e3a6-4271-9ff1-758ed062486b tempest-SnapshotDependencyTests-374637800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a3f65234-e3a6-4271-9ff1-758ed062486b tempest-SnapshotDependencyTests-374637800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:31:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a3f65234-e3a6-4271-9ff1-758ed062486b tempest-SnapshotDependencyTests-374637800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:31:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a3f65234-e3a6-4271-9ff1-758ed062486b tempest-SnapshotDependencyTests-374637800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a3f65234-e3a6-4271-9ff1-758ed062486b tempest-SnapshotDependencyTests-374637800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:24 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:31:24 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:24 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a3f65234-e3a6-4271-9ff1-758ed062486b tempest-SnapshotDependencyTests-374637800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.236s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:24 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-a3f65234-e3a6-4271-9ff1-758ed062486b tempest-SnapshotDependencyTests-374637800 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:31:24 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-a3f65234-e3a6-4271-9ff1-758ed062486b tempest-SnapshotDependencyTests-374637800 None] Deleted volume successfully. Sep 09 18:31:24 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a3f65234-e3a6-4271-9ff1-758ed062486b tempest-SnapshotDependencyTests-374637800 None] Lock "cinder-be3747c0-bbc1-427b-a671-1b89af1c96a4-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:31:24 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3aeb1671-dcd6-4b74-82ca-c00df60b9845 tempest-SnapshotDependencyTests-374637800 None] Acquiring lock "cinder-e7aea121-8e6d-466c-9e7d-b657ec464c39-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:31:25 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3aeb1671-dcd6-4b74-82ca-c00df60b9845 tempest-SnapshotDependencyTests-374637800 None] Lock "cinder-e7aea121-8e6d-466c-9e7d-b657ec464c39-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:31:25 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3aeb1671-dcd6-4b74-82ca-c00df60b9845 tempest-SnapshotDependencyTests-374637800 None] Acquiring lock "cinder-quobyte-e7aea121-8e6d-466c-9e7d-b657ec464c39" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:31:25 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3aeb1671-dcd6-4b74-82ca-c00df60b9845 tempest-SnapshotDependencyTests-374637800 None] Lock "cinder-quobyte-e7aea121-8e6d-466c-9e7d-b657ec464c39" acquired by "delete_volume" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:31:25 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c3aeb5-8378-4f8a-a965-c8e1d6b71816]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:31:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3aeb1671-dcd6-4b74-82ca-c00df60b9845 tempest-SnapshotDependencyTests-374637800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e7aea121-8e6d-466c-9e7d-b657ec464c39 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:25 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e7aea121-8e6d-466c-9e7d-b657ec464c39 Sep 09 18:31:25 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:25 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3aeb1671-dcd6-4b74-82ca-c00df60b9845 tempest-SnapshotDependencyTests-374637800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e7aea121-8e6d-466c-9e7d-b657ec464c39" returned: 0 in 0.344s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3aeb1671-dcd6-4b74-82ca-c00df60b9845 tempest-SnapshotDependencyTests-374637800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e7aea121-8e6d-466c-9e7d-b657ec464c39 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:25 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e7aea121-8e6d-466c-9e7d-b657ec464c39 Sep 09 18:31:25 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:25 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3aeb1671-dcd6-4b74-82ca-c00df60b9845 tempest-SnapshotDependencyTests-374637800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e7aea121-8e6d-466c-9e7d-b657ec464c39" returned: 0 in 0.234s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:25 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3aeb1671-dcd6-4b74-82ca-c00df60b9845 tempest-SnapshotDependencyTests-374637800 None] Lock "cinder-quobyte-e7aea121-8e6d-466c-9e7d-b657ec464c39" released by "delete_volume" :: held 0.611s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:31:25 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-3aeb1671-dcd6-4b74-82ca-c00df60b9845 tempest-SnapshotDependencyTests-374637800 None] Created reservations ['73964011-b877-4f0b-ac0a-2a232e803a9c', '18b1cfaa-cad3-43c0-8654-a11a6d20d6b3', '57602558-571a-4f64-afac-0a6dab3bd202', '8a1e720f-4f0f-4d64-9dae-d64af49898b0'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:31:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3aeb1671-dcd6-4b74-82ca-c00df60b9845 tempest-SnapshotDependencyTests-374637800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3aeb1671-dcd6-4b74-82ca-c00df60b9845 tempest-SnapshotDependencyTests-374637800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:25 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3aeb1671-dcd6-4b74-82ca-c00df60b9845 tempest-SnapshotDependencyTests-374637800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:31:25 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3aeb1671-dcd6-4b74-82ca-c00df60b9845 tempest-SnapshotDependencyTests-374637800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:31:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3aeb1671-dcd6-4b74-82ca-c00df60b9845 tempest-SnapshotDependencyTests-374637800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3aeb1671-dcd6-4b74-82ca-c00df60b9845 tempest-SnapshotDependencyTests-374637800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:25 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:31:25 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:26 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3aeb1671-dcd6-4b74-82ca-c00df60b9845 tempest-SnapshotDependencyTests-374637800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.235s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:26 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-3aeb1671-dcd6-4b74-82ca-c00df60b9845 tempest-SnapshotDependencyTests-374637800 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:31:26 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-3aeb1671-dcd6-4b74-82ca-c00df60b9845 tempest-SnapshotDependencyTests-374637800 None] Deleted volume successfully. Sep 09 18:31:26 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3aeb1671-dcd6-4b74-82ca-c00df60b9845 tempest-SnapshotDependencyTests-374637800 None] Lock "cinder-e7aea121-8e6d-466c-9e7d-b657ec464c39-delete_volume" released by "delete_volume" :: held 1.039s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:31:35 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=27,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:31:36 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:UPDATE=30,cinder:SELECT=22,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:31:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:31:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:31:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:31:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:43 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:31:43 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:43 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.285s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:31:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:31:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 29 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:31:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:31:46 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:31:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Flow 'volume_create_manager' (2fa53210-9860-4db7-85ff-e1fadc85b51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:31:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f82227b8-4a67-44b3-b933-d7ae99d2a825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f82227b8-4a67-44b3-b933-d7ae99d2a825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1009134971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd27ee87-60c7-42ba-9c77-6e09c3944c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f40ae78e5b438f8b65caa2f45725d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:31:47Z,use_quota=True,user_id='65e25f84b0d643f78ce7ad013468d201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34bfd04b-1a81-4257-a39d-eddb67a06d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34bfd04b-1a81-4257-a39d-eddb67a06d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc983352-d93c-4bbf-8fca-825cbb3718b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc983352-d93c-4bbf-8fca-825cbb3718b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd27ee87-60c7-42ba-9c77-6e09c3944c8e', 'volume_name': 'volume-cd27ee87-60c7-42ba-9c77-6e09c3944c8e', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91cfe9e9-1438-4f3e-a780-9b1dd9c69b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91cfe9e9-1438-4f3e-a780-9b1dd9c69b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e3a009-893b-4e09-a0d6-fa9b18a31f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:46 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Volume cd27ee87-60c7-42ba-9c77-6e09c3944c8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd27ee87-60c7-42ba-9c77-6e09c3944c8e', 'volume_size': 1} Sep 09 18:31:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:46 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1009134971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd27ee87-60c7-42ba-9c77-6e09c3944c8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f40ae78e5b438f8b65caa2f45725d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:31:47Z,use_quota=True,user_id='65e25f84b0d643f78ce7ad013468d201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:31:46 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Creating volume cd27ee87-60c7-42ba-9c77-6e09c3944c8e {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:31:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:46 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:31:46 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:31:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:46 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:31:46 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:31:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cd27ee87-60c7-42ba-9c77-6e09c3944c8e 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:46 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cd27ee87-60c7-42ba-9c77-6e09c3944c8e 1073741824 Sep 09 18:31:46 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:47 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cd27ee87-60c7-42ba-9c77-6e09c3944c8e 1073741824" returned: 0 in 0.511s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cd27ee87-60c7-42ba-9c77-6e09c3944c8e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:47 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cd27ee87-60c7-42ba-9c77-6e09c3944c8e Sep 09 18:31:47 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0e66beb7-737f-49fd-8169-1ca81bada907 tempest-ProjectAdminTests-1603600676 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.32279586792, 'free_capacity_gb': 1773.32279586792, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87639) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 09 18:31:47 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cd27ee87-60c7-42ba-9c77-6e09c3944c8e" returned: 0 in 0.291s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:31:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e3a009-893b-4e09-a0d6-fa9b18a31f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd27ee87-60c7-42ba-9c77-6e09c3944c8e', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96c00be8-e701-4f34-b776-54592667d205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:47 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Volume volume-cd27ee87-60c7-42ba-9c77-6e09c3944c8e (cd27ee87-60c7-42ba-9c77-6e09c3944c8e): created successfully Sep 09 18:31:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96c00be8-e701-4f34-b776-54592667d205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Flow 'volume_create_manager' (2fa53210-9860-4db7-85ff-e1fadc85b51d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:31:47 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-0d600514-41a7-48d0-adbc-74835961545c tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Created volume successfully. Sep 09 18:31:49 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:31:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Flow 'volume_create_manager' (f727c4e4-492d-4f70-9338-47d4a60109ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:31:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d494dbb6-c954-4c2e-906e-c7ddb47a1e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d494dbb6-c954-4c2e-906e-c7ddb47a1e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1925987202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb8748a6-3caa-4bd0-9771-caf4703e1f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f40ae78e5b438f8b65caa2f45725d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:31:50Z,use_quota=True,user_id='65e25f84b0d643f78ce7ad013468d201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d08cfe4-01b2-46d0-a257-6221c063abcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d08cfe4-01b2-46d0-a257-6221c063abcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d77fa3f-f506-4dc0-869e-3329a77c4cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d77fa3f-f506-4dc0-869e-3329a77c4cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb8748a6-3caa-4bd0-9771-caf4703e1f7e', 'volume_name': 'volume-eb8748a6-3caa-4bd0-9771-caf4703e1f7e', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de7e22b-c7e9-47d6-aa3d-35f4f26dcbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de7e22b-c7e9-47d6-aa3d-35f4f26dcbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:49 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d8d87e8-fbd4-407b-916b-c3f79dd0cc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:49 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Volume eb8748a6-3caa-4bd0-9771-caf4703e1f7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb8748a6-3caa-4bd0-9771-caf4703e1f7e', 'volume_size': 1} Sep 09 18:31:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:49 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1925987202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb8748a6-3caa-4bd0-9771-caf4703e1f7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f40ae78e5b438f8b65caa2f45725d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:31:50Z,use_quota=True,user_id='65e25f84b0d643f78ce7ad013468d201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:31:49 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Creating volume eb8748a6-3caa-4bd0-9771-caf4703e1f7e {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:31:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:49 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:31:49 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:31:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:49 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:31:49 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:31:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-eb8748a6-3caa-4bd0-9771-caf4703e1f7e 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:49 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-eb8748a6-3caa-4bd0-9771-caf4703e1f7e 1073741824 Sep 09 18:31:49 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Flow 'volume_create_manager' (53ce34c7-e137-4f7e-91b6-86eb679ecb21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad1007e-4d74-4a1d-b02d-4c0670ed85b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad1007e-4d74-4a1d-b02d-4c0670ed85b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1833974178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de693157-ee7e-439d-a29a-3cba078fe1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f40ae78e5b438f8b65caa2f45725d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:31:50Z,use_quota=True,user_id='65e25f84b0d643f78ce7ad013468d201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e16ee5f-ad3d-4858-9359-f4c6ed5f7868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e16ee5f-ad3d-4858-9359-f4c6ed5f7868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e024439b-0e4a-4b70-a0e9-e570a23619bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e024439b-0e4a-4b70-a0e9-e570a23619bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de693157-ee7e-439d-a29a-3cba078fe1d6', 'volume_name': 'volume-de693157-ee7e-439d-a29a-3cba078fe1d6', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace5b10a-5135-4c91-b692-ef611deb971e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace5b10a-5135-4c91-b692-ef611deb971e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46afb4bc-81ea-4f71-bcf0-b2913f4a8e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:50 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Volume de693157-ee7e-439d-a29a-3cba078fe1d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de693157-ee7e-439d-a29a-3cba078fe1d6', 'volume_size': 1} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:50 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-eb8748a6-3caa-4bd0-9771-caf4703e1f7e 1073741824" returned: 0 in 0.851s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-eb8748a6-3caa-4bd0-9771-caf4703e1f7e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:50 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-eb8748a6-3caa-4bd0-9771-caf4703e1f7e Sep 09 18:31:50 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:50 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-eb8748a6-3caa-4bd0-9771-caf4703e1f7e" returned: 0 in 0.295s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.632s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1833974178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de693157-ee7e-439d-a29a-3cba078fe1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f40ae78e5b438f8b65caa2f45725d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:31:50Z,use_quota=True,user_id='65e25f84b0d643f78ce7ad013468d201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Creating volume de693157-ee7e-439d-a29a-3cba078fe1d6 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:31:50 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:31:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-de693157-ee7e-439d-a29a-3cba078fe1d6 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d8d87e8-fbd4-407b-916b-c3f79dd0cc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb8748a6-3caa-4bd0-9771-caf4703e1f7e', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a79ea4c-e74b-4fde-bd08-bac051b9969f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:51 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-de693157-ee7e-439d-a29a-3cba078fe1d6 1073741824 Sep 09 18:31:51 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:51 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Volume volume-eb8748a6-3caa-4bd0-9771-caf4703e1f7e (eb8748a6-3caa-4bd0-9771-caf4703e1f7e): created successfully Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a79ea4c-e74b-4fde-bd08-bac051b9969f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Flow 'volume_create_manager' (f727c4e4-492d-4f70-9338-47d4a60109ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:31:51 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-950a9a58-f3ed-4d13-855b-6e44e713bb8a tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Created volume successfully. Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Flow 'volume_create_manager' (5786810b-1d43-410d-961e-149ebb1f6790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ecfe66-aa41-462f-916e-5ea222da4a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17ecfe66-aa41-462f-916e-5ea222da4a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55983b8c-37f3-43a6-afc7-a97d24bf32c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7d5267b39947bba629b40839b035e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:31:51Z,use_quota=True,user_id='8640978d411d483a8401c221b1e24508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303ec968-e411-4464-a789-d25202d0f3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303ec968-e411-4464-a789-d25202d0f3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a20a26de-0554-450f-bf2c-a8a4a0910f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.image.glance [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Creating Keystone auth plugin from conf {{(pid=87639) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Flow 'volume_create_manager' (c4a4499c-98cb-4dff-a17f-f29d689fab42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3563e56b-38a5-497d-96bb-8ae0c6a986e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3563e56b-38a5-497d-96bb-8ae0c6a986e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1372830992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df899fb9-42ac-43bd-9586-5e3dc225a0c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f40ae78e5b438f8b65caa2f45725d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:31:51Z,use_quota=True,user_id='65e25f84b0d643f78ce7ad013468d201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a67bbe-382f-4c75-8962-887af38870d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43a67bbe-382f-4c75-8962-887af38870d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50bee878-fcab-4939-918f-285b3afe1935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50bee878-fcab-4939-918f-285b3afe1935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df899fb9-42ac-43bd-9586-5e3dc225a0c7', 'volume_name': 'volume-df899fb9-42ac-43bd-9586-5e3dc225a0c7', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad754fbe-5863-41ba-8bc6-3708f44d3b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad754fbe-5863-41ba-8bc6-3708f44d3b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45257f97-a70e-4a22-a8ac-24cbe2696d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:51 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Volume df899fb9-42ac-43bd-9586-5e3dc225a0c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df899fb9-42ac-43bd-9586-5e3dc225a0c7', 'volume_size': 1} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Flow 'volume_create_manager' (f1a16817-be2c-4525-a246-8ea21c14e88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e29bb3d-ebd1-4f25-9a1a-dd309af0dd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e29bb3d-ebd1-4f25-9a1a-dd309af0dd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-837504967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47647674-4f37-457a-acff-0ddd79fede7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f40ae78e5b438f8b65caa2f45725d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:31:52Z,use_quota=True,user_id='65e25f84b0d643f78ce7ad013468d201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a33e599c-747b-47cc-ab7d-1bfecd86df7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a33e599c-747b-47cc-ab7d-1bfecd86df7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2cff0ec-2c94-4759-a433-3a1f40c69bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2cff0ec-2c94-4759-a433-3a1f40c69bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47647674-4f37-457a-acff-0ddd79fede7e', 'volume_name': 'volume-47647674-4f37-457a-acff-0ddd79fede7e', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:51 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb24fb65-b6e1-4f9b-a424-f8c9553d887a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb24fb65-b6e1-4f9b-a424-f8c9553d887a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440c4f1e-eabd-4593-aaf5-92c1ed5ae9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:51 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Volume 47647674-4f37-457a-acff-0ddd79fede7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47647674-4f37-457a-acff-0ddd79fede7e', 'volume_size': 1} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-de693157-ee7e-439d-a29a-3cba078fe1d6 1073741824" returned: 0 in 0.972s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Flow 'volume_create_manager' (adffe463-1f94-4473-bf26-ddd75e1a6be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:31:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7152ca5-b94a-409d-90e0-37bea5fec7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7152ca5-b94a-409d-90e0-37bea5fec7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1515548635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da54230-d456-4165-85d3-3ed8e5c6b1e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f40ae78e5b438f8b65caa2f45725d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:31:52Z,use_quota=True,user_id='65e25f84b0d643f78ce7ad013468d201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9a3ccd-5cac-4818-b11c-91dabf8f46ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9a3ccd-5cac-4818-b11c-91dabf8f46ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c2cc9a-a579-4c89-a8a3-c60e628c18bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c2cc9a-a579-4c89-a8a3-c60e628c18bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0da54230-d456-4165-85d3-3ed8e5c6b1e3', 'volume_name': 'volume-0da54230-d456-4165-85d3-3ed8e5c6b1e3', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882094fa-6051-479f-88f9-b41d559500d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882094fa-6051-479f-88f9-b41d559500d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36127a83-1a4a-442e-b39b-3b35de990a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:52 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Volume 0da54230-d456-4165-85d3-3ed8e5c6b1e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0da54230-d456-4165-85d3-3ed8e5c6b1e3', 'volume_size': 1} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-de693157-ee7e-439d-a29a-3cba078fe1d6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a20a26de-0554-450f-bf2c-a8a4a0910f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '55983b8c-37f3-43a6-afc7-a97d24bf32c5', 'volume_name': 'volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5', 'volume_size': 1, 'image_id': '36e2fb0f-5e44-4490-8115-08f43f26e2a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36e2fb0f-5e44-4490-8115-08f43f26e2a0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c0b0a2fcea89919b78c9b73902a142c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6e7d5267b39947bba629b40839b035e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fda1251f920e88f629dd58f020367723a0ec16885909b74a8a1752956089b0516e46b3ecf085fd8f829d614f31b0e4692c170fe0c93934966634e40713aa57db', 'id': '36e2fb0f-5e44-4490-8115-08f43f26e2a0', 'created_at': datetime.datetime(2026, 9, 9, 16, 31, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 31, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36e2fb0f-5e44-4490-8115-08f43f26e2a0/file', 'properties': {}}, 'image_service': }' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec58ae2b-1771-47ae-92e5-5ccf411d5691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:52 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-de693157-ee7e-439d-a29a-3cba078fe1d6 Sep 09 18:31:52 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec58ae2b-1771-47ae-92e5-5ccf411d5691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc15ce1-3c2a-49f9-8541-afc3df835603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:52 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Volume 55983b8c-37f3-43a6-afc7-a97d24bf32c5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5', 'volume_size': 1, 'image_id': '36e2fb0f-5e44-4490-8115-08f43f26e2a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36e2fb0f-5e44-4490-8115-08f43f26e2a0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c0b0a2fcea89919b78c9b73902a142c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6e7d5267b39947bba629b40839b035e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fda1251f920e88f629dd58f020367723a0ec16885909b74a8a1752956089b0516e46b3ecf085fd8f829d614f31b0e4692c170fe0c93934966634e40713aa57db', 'id': '36e2fb0f-5e44-4490-8115-08f43f26e2a0', 'created_at': datetime.datetime(2026, 9, 9, 16, 31, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 31, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36e2fb0f-5e44-4490-8115-08f43f26e2a0/file', 'properties': {}}, 'image_service': } Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Trying to clone 55983b8c-37f3-43a6-afc7-a97d24bf32c5 from image 36e2fb0f-5e44-4490-8115-08f43f26e2a0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/36e2fb0f-5e44-4490-8115-08f43f26e2a0', 'metadata': {}}]). {{(pid=87639) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 18:31:52 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Image download 0.00 MB at 0.00 MB/s Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b34787-4fda-4d79-b10c-2f2fe62055f0]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:52 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-de693157-ee7e-439d-a29a-3cba078fe1d6" returned: 0 in 0.339s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.844s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1372830992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df899fb9-42ac-43bd-9586-5e3dc225a0c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f40ae78e5b438f8b65caa2f45725d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:31:51Z,use_quota=True,user_id='65e25f84b0d643f78ce7ad013468d201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Creating volume df899fb9-42ac-43bd-9586-5e3dc225a0c7 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:31:52 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD Sep 09 18:31:52 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:31:52 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df899fb9-42ac-43bd-9586-5e3dc225a0c7 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:52 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df899fb9-42ac-43bd-9586-5e3dc225a0c7 1073741824 Sep 09 18:31:52 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46afb4bc-81ea-4f71-bcf0-b2913f4a8e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de693157-ee7e-439d-a29a-3cba078fe1d6', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2f9eb0-8970-43c6-bc5a-599c23798568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:52 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Volume volume-de693157-ee7e-439d-a29a-3cba078fe1d6 (de693157-ee7e-439d-a29a-3cba078fe1d6): created successfully Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2f9eb0-8970-43c6-bc5a-599c23798568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Flow 'volume_create_manager' (53ce34c7-e137-4f7e-91b6-86eb679ecb21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:31:52 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-47a58ddd-ae73-4c2c-9b2a-d12841380cd7 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Created volume successfully. Sep 09 18:31:52 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD" returned: 0 in 0.450s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:52 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD Sep 09 18:31:52 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:31:53 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Flow 'volume_create_manager' (4eb7d223-9147-44fe-b0f4-f58bfdf768b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb5aea5-1a06-4879-a68d-2d30339859fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df899fb9-42ac-43bd-9586-5e3dc225a0c7 1073741824" returned: 0 in 0.684s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb5aea5-1a06-4879-a68d-2d30339859fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fcb39ca-51d1-45be-893b-7517ef0c5452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0704460ac24c9e999e51b93f5934f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:31:53Z,use_quota=True,user_id='9c2b732aa89743abb6cd791f86322d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4955286-4585-4d76-b9a6-730ece6a0b00),volume_type_id=c4955286-4585-4d76-b9a6-730ece6a0b00)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8c8032-975d-4717-8983-0199960a9165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8c8032-975d-4717-8983-0199960a9165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:53 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b001eb-76ad-4074-941d-b2504a348da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.image.glance [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Creating Keystone auth plugin from conf {{(pid=87639) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD" returned: 1 in 0.438s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Temporary image 36e2fb0f-5e44-4490-8115-08f43f26e2a0 is fetched for user 8640978d411d483a8401c221b1e24508. {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df899fb9-42ac-43bd-9586-5e3dc225a0c7 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:53 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df899fb9-42ac-43bd-9586-5e3dc225a0c7 Sep 09 18:31:53 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebd1f20-5984-4105-9c11-cb1637201aba]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:53 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD Sep 09 18:31:53 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:53 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df899fb9-42ac-43bd-9586-5e3dc225a0c7" returned: 0 in 0.293s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.574s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-837504967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47647674-4f37-457a-acff-0ddd79fede7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f40ae78e5b438f8b65caa2f45725d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:31:52Z,use_quota=True,user_id='65e25f84b0d643f78ce7ad013468d201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Creating volume 47647674-4f37-457a-acff-0ddd79fede7e {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:31:53 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-47647674-4f37-457a-acff-0ddd79fede7e 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:53 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-47647674-4f37-457a-acff-0ddd79fede7e 1073741824 Sep 09 18:31:53 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45257f97-a70e-4a22-a8ac-24cbe2696d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df899fb9-42ac-43bd-9586-5e3dc225a0c7', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c03dfe-c568-479a-9093-089c38458323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:53 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Volume volume-df899fb9-42ac-43bd-9586-5e3dc225a0c7 (df899fb9-42ac-43bd-9586-5e3dc225a0c7): created successfully Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c03dfe-c568-479a-9093-089c38458323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Flow 'volume_create_manager' (c4a4499c-98cb-4dff-a17f-f29d689fab42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b001eb-76ad-4074-941d-b2504a348da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8fcb39ca-51d1-45be-893b-7517ef0c5452', 'volume_name': 'volume-8fcb39ca-51d1-45be-893b-7517ef0c5452', 'volume_size': 1, 'image_id': '293ecc22-3a06-4631-ae6b-0c54b5dcda33', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/293ecc22-3a06-4631-ae6b-0c54b5dcda33', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c6f6f73274e3f8593d8c0f74fc4a92b4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bd0704460ac24c9e999e51b93f5934f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fd173b83158e422e4a14e3cb9c6ceccdd9f7c94db185a536d6fa0a890d1f4f41aa6146691a0a11912253076640cd947df7d09c986c6e0ce532c74f55b252045d', 'id': '293ecc22-3a06-4631-ae6b-0c54b5dcda33', 'created_at': datetime.datetime(2026, 9, 9, 16, 31, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 31, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/293ecc22-3a06-4631-ae6b-0c54b5dcda33/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b223a11-b906-4853-9893-160be6d9510c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b223a11-b906-4853-9893-160be6d9510c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6530e4c6-bdce-46e4-be7e-2f478c79dff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:53 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Volume 8fcb39ca-51d1-45be-893b-7517ef0c5452: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8fcb39ca-51d1-45be-893b-7517ef0c5452', 'volume_size': 1, 'image_id': '293ecc22-3a06-4631-ae6b-0c54b5dcda33', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/293ecc22-3a06-4631-ae6b-0c54b5dcda33', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c6f6f73274e3f8593d8c0f74fc4a92b4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bd0704460ac24c9e999e51b93f5934f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fd173b83158e422e4a14e3cb9c6ceccdd9f7c94db185a536d6fa0a890d1f4f41aa6146691a0a11912253076640cd947df7d09c986c6e0ce532c74f55b252045d', 'id': '293ecc22-3a06-4631-ae6b-0c54b5dcda33', 'created_at': datetime.datetime(2026, 9, 9, 16, 31, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 31, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/293ecc22-3a06-4631-ae6b-0c54b5dcda33/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Trying to clone 8fcb39ca-51d1-45be-893b-7517ef0c5452 from image 293ecc22-3a06-4631-ae6b-0c54b5dcda33 at location (None, [{'url': 'file:///opt/stack/data/glance/images/293ecc22-3a06-4631-ae6b-0c54b5dcda33', 'metadata': {}}]). {{(pid=87639) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 18:31:53 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-a7d93373-5a19-4219-8c05-f6f3ff92fd52 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Created volume successfully. Sep 09 18:31:53 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD" returned: 0 in 0.511s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 18:31:53 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Image download 0.00 MB at 0.00 MB/s Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e802c6ec-344b-4a9e-a10b-52c179e41e19]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:31:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:53 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD Sep 09 18:31:53 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:54 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD Sep 09 18:31:54 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:54 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-47647674-4f37-457a-acff-0ddd79fede7e 1073741824" returned: 0 in 0.671s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-47647674-4f37-457a-acff-0ddd79fede7e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:54 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD" returned: 1 in 0.474s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:54 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-47647674-4f37-457a-acff-0ddd79fede7e Sep 09 18:31:54 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:54 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:54 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD Sep 09 18:31:54 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:54 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-47647674-4f37-457a-acff-0ddd79fede7e" returned: 0 in 0.298s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.497s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1515548635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da54230-d456-4165-85d3-3ed8e5c6b1e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f40ae78e5b438f8b65caa2f45725d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:31:52Z,use_quota=True,user_id='65e25f84b0d643f78ce7ad013468d201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Creating volume 0da54230-d456-4165-85d3-3ed8e5c6b1e3 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:31:54 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0da54230-d456-4165-85d3-3ed8e5c6b1e3 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440c4f1e-eabd-4593-aaf5-92c1ed5ae9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47647674-4f37-457a-acff-0ddd79fede7e', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14266940-9e80-4027-89b9-4af74299a88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:54 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0da54230-d456-4165-85d3-3ed8e5c6b1e3 1073741824 Sep 09 18:31:54 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:54 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Volume volume-47647674-4f37-457a-acff-0ddd79fede7e (47647674-4f37-457a-acff-0ddd79fede7e): created successfully Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14266940-9e80-4027-89b9-4af74299a88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Flow 'volume_create_manager' (f1a16817-be2c-4525-a246-8ea21c14e88e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:31:54 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-c4808cc7-a14a-4fa3-940f-26c1a3753c7f tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Created volume successfully. Sep 09 18:31:54 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD" returned: 1 in 0.393s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Temporary image 293ecc22-3a06-4631-ae6b-0c54b5dcda33 is fetched for user 9c2b732aa89743abb6cd791f86322d16. {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f52e02-ea2e-4c8c-a533-9995ae0c3c9d]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:31:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:54 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD Sep 09 18:31:54 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:55 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0da54230-d456-4165-85d3-3ed8e5c6b1e3 1073741824" returned: 0 in 0.537s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0da54230-d456-4165-85d3-3ed8e5c6b1e3 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:55 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0da54230-d456-4165-85d3-3ed8e5c6b1e3 Sep 09 18:31:55 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:55 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:55 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD Sep 09 18:31:55 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:55 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0da54230-d456-4165-85d3-3ed8e5c6b1e3" returned: 0 in 0.286s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.165s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55983b8c-37f3-43a6-afc7-a97d24bf32c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e7d5267b39947bba629b40839b035e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:31:51Z,use_quota=True,user_id='8640978d411d483a8401c221b1e24508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Creating volume 55983b8c-37f3-43a6-afc7-a97d24bf32c5 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:31:55 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36127a83-1a4a-442e-b39b-3b35de990a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0da54230-d456-4165-85d3-3ed8e5c6b1e3', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8fe3e4-868b-4cdc-b58e-8bf1c1e36464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:55 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5 1073741824 Sep 09 18:31:55 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:55 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Volume volume-0da54230-d456-4165-85d3-3ed8e5c6b1e3 (0da54230-d456-4165-85d3-3ed8e5c6b1e3): created successfully Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8fe3e4-868b-4cdc-b58e-8bf1c1e36464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Flow 'volume_create_manager' (adffe463-1f94-4473-bf26-ddd75e1a6be6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:31:55 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-32fd8ce4-f713-4bb4-b120-297e72f594e4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Created volume successfully. Sep 09 18:31:55 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD" returned: 1 in 0.365s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:55 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5 1073741824" returned: 0 in 0.493s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:56 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5 Sep 09 18:31:56 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:56 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5" returned: 0 in 0.320s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.727s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fcb39ca-51d1-45be-893b-7517ef0c5452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0704460ac24c9e999e51b93f5934f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:31:53Z,use_quota=True,user_id='9c2b732aa89743abb6cd791f86322d16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c4955286-4585-4d76-b9a6-730ece6a0b00),volume_type_id=c4955286-4585-4d76-b9a6-730ece6a0b00)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Creating volume 8fcb39ca-51d1-45be-893b-7517ef0c5452 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:31:56 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8fcb39ca-51d1-45be-893b-7517ef0c5452 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:56 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8fcb39ca-51d1-45be-893b-7517ef0c5452 1073741824 Sep 09 18:31:56 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Attempting download of 36e2fb0f-5e44-4490-8115-08f43f26e2a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/36e2fb0f-5e44-4490-8115-08f43f26e2a0', 'metadata': {}}])) to volume 55983b8c-37f3-43a6-afc7-a97d24bf32c5. {{(pid=87639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-78a508d7-6126-407d-99d4-3653726a4797 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "cinder-0da54230-d456-4165-85d3-3ed8e5c6b1e3-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-78a508d7-6126-407d-99d4-3653726a4797 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-0da54230-d456-4165-85d3-3ed8e5c6b1e3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e960f023-3e7c-4984-884c-51f59c443afa]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36e2fb0f-5e44-4490-8115-08f43f26e2a0_iglav624 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-78a508d7-6126-407d-99d4-3653726a4797 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "cinder-quobyte-0da54230-d456-4165-85d3-3ed8e5c6b1e3" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-78a508d7-6126-407d-99d4-3653726a4797 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-quobyte-0da54230-d456-4165-85d3-3ed8e5c6b1e3" acquired by "delete_volume" :: waited 0.026s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b16bde-4c26-4682-bb92-6c9e38294fe1]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-78a508d7-6126-407d-99d4-3653726a4797 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0da54230-d456-4165-85d3-3ed8e5c6b1e3 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:56 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36e2fb0f-5e44-4490-8115-08f43f26e2a0_iglav624 Sep 09 18:31:56 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:56 devstack sudo[107376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0da54230-d456-4165-85d3-3ed8e5c6b1e3 Sep 09 18:31:56 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:56 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8fcb39ca-51d1-45be-893b-7517ef0c5452 1073741824" returned: 0 in 0.504s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8fcb39ca-51d1-45be-893b-7517ef0c5452 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:56 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_36e2fb0f-5e44-4490-8115-08f43f26e2a0_iglav624" returned: 0 in 0.436s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36e2fb0f-5e44-4490-8115-08f43f26e2a0_iglav624 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:56 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8fcb39ca-51d1-45be-893b-7517ef0c5452 Sep 09 18:31:56 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:57 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36e2fb0f-5e44-4490-8115-08f43f26e2a0_iglav624 Sep 09 18:31:57 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:57 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-78a508d7-6126-407d-99d4-3653726a4797 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0da54230-d456-4165-85d3-3ed8e5c6b1e3" returned: 0 in 0.472s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-78a508d7-6126-407d-99d4-3653726a4797 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0da54230-d456-4165-85d3-3ed8e5c6b1e3 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:57 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0da54230-d456-4165-85d3-3ed8e5c6b1e3 Sep 09 18:31:57 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:57 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8fcb39ca-51d1-45be-893b-7517ef0c5452" returned: 0 in 0.284s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Attempting download of 293ecc22-3a06-4631-ae6b-0c54b5dcda33 ((None, [{'url': 'file:///opt/stack/data/glance/images/293ecc22-3a06-4631-ae6b-0c54b5dcda33', 'metadata': {}}])) to volume 8fcb39ca-51d1-45be-893b-7517ef0c5452. {{(pid=87639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[399973be-2c3a-446e-bcd2-068220d7d599]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_293ecc22-3a06-4631-ae6b-0c54b5dcda33_r5p2bibm {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:57 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36e2fb0f-5e44-4490-8115-08f43f26e2a0_iglav624" returned: 1 in 0.431s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_36e2fb0f-5e44-4490-8115-08f43f26e2a0_iglav624' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c8c85c-0ec8-45ae-bad3-e86d8c16b842]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:57 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_293ecc22-3a06-4631-ae6b-0c54b5dcda33_r5p2bibm Sep 09 18:31:57 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:57 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-78a508d7-6126-407d-99d4-3653726a4797 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-0da54230-d456-4165-85d3-3ed8e5c6b1e3" returned: 0 in 0.397s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:57 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD Sep 09 18:31:57 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-78a508d7-6126-407d-99d4-3653726a4797 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-quobyte-0da54230-d456-4165-85d3-3ed8e5c6b1e3" released by "delete_volume" :: held 0.930s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-78a508d7-6126-407d-99d4-3653726a4797 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Created reservations ['81eaf693-1407-45a7-b1b7-2217f4bad526', 'adddfad3-cf2a-4aac-9492-d81c0ab11ad8', '69a2f800-9f43-466b-b543-4c8fce6001bf', '6105a038-f35e-4f31-9ed4-879c7e0c14b7'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-78a508d7-6126-407d-99d4-3653726a4797 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-78a508d7-6126-407d-99d4-3653726a4797 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-78a508d7-6126-407d-99d4-3653726a4797 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-78a508d7-6126-407d-99d4-3653726a4797 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-78a508d7-6126-407d-99d4-3653726a4797 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-78a508d7-6126-407d-99d4-3653726a4797 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:57 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_293ecc22-3a06-4631-ae6b-0c54b5dcda33_r5p2bibm" returned: 0 in 0.433s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_293ecc22-3a06-4631-ae6b-0c54b5dcda33_r5p2bibm {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:57 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:31:57 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:57 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD" returned: 0 in 0.445s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:57 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_293ecc22-3a06-4631-ae6b-0c54b5dcda33_r5p2bibm Sep 09 18:31:57 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:57 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD Sep 09 18:31:57 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:57 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-78a508d7-6126-407d-99d4-3653726a4797 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.280s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:57 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-78a508d7-6126-407d-99d4-3653726a4797 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:31:58 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-78a508d7-6126-407d-99d4-3653726a4797 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Deleted volume successfully. Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-78a508d7-6126-407d-99d4-3653726a4797 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-0da54230-d456-4165-85d3-3ed8e5c6b1e3-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:31:58 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_293ecc22-3a06-4631-ae6b-0c54b5dcda33_r5p2bibm" returned: 1 in 0.399s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:58 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_293ecc22-3a06-4631-ae6b-0c54b5dcda33_r5p2bibm' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bcfbd0-1d60-41d2-880b-2e069acae853]: (4, 'raw') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD" returned: 1 in 0.430s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] 36e2fb0f-5e44-4490-8115-08f43f26e2a0 was raw, converting to qcow2 {{(pid=87639) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:58 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5 Sep 09 18:31:58 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:58 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD Sep 09 18:31:58 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:58 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a64acad4-2970-4230-9e13-d1dab8b45158 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "cinder-47647674-4f37-457a-acff-0ddd79fede7e-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:31:58 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD Sep 09 18:31:58 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a64acad4-2970-4230-9e13-d1dab8b45158 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-47647674-4f37-457a-acff-0ddd79fede7e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a64acad4-2970-4230-9e13-d1dab8b45158 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "cinder-quobyte-47647674-4f37-457a-acff-0ddd79fede7e" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a64acad4-2970-4230-9e13-d1dab8b45158 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-quobyte-47647674-4f37-457a-acff-0ddd79fede7e" acquired by "delete_volume" :: waited 0.028s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[47df4b00-2e3d-4914-be9f-d0a40180d0f0]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a64acad4-2970-4230-9e13-d1dab8b45158 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-47647674-4f37-457a-acff-0ddd79fede7e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:58 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5" returned: 0 in 0.661s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_36e2fb0f-5e44-4490-8115-08f43f26e2a0_gtp53ou6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5 {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:31:58 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Converted 0.00 MB image at 0.00 MB/s Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:58 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5 1G Sep 09 18:31:58 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:58 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD" returned: 1 in 0.415s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] 293ecc22-3a06-4631-ae6b-0c54b5dcda33 was raw, converting to qcow2 {{(pid=87639) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 18:31:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8fcb39ca-51d1-45be-893b-7517ef0c5452 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:58 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-47647674-4f37-457a-acff-0ddd79fede7e Sep 09 18:31:58 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:59 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8fcb39ca-51d1-45be-893b-7517ef0c5452 Sep 09 18:31:59 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:59 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a64acad4-2970-4230-9e13-d1dab8b45158 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-47647674-4f37-457a-acff-0ddd79fede7e" returned: 0 in 0.449s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a64acad4-2970-4230-9e13-d1dab8b45158 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-47647674-4f37-457a-acff-0ddd79fede7e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:59 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-47647674-4f37-457a-acff-0ddd79fede7e Sep 09 18:31:59 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:59 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5 1G" returned: 0 in 0.473s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Downloaded image 36e2fb0f-5e44-4490-8115-08f43f26e2a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/36e2fb0f-5e44-4490-8115-08f43f26e2a0', 'metadata': {}}])) to volume 55983b8c-37f3-43a6-afc7-a97d24bf32c5 successfully. {{(pid=87639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Temporary image 36e2fb0f-5e44-4490-8115-08f43f26e2a0 for user 8640978d411d483a8401c221b1e24508 is deleted. {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Marking volume 55983b8c-37f3-43a6-afc7-a97d24bf32c5 as bootable. {{(pid=87639) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Copying metadata from image 36e2fb0f-5e44-4490-8115-08f43f26e2a0 to 55983b8c-37f3-43a6-afc7-a97d24bf32c5. {{(pid=87639) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Creating volume glance metadata for volume 55983b8c-37f3-43a6-afc7-a97d24bf32c5 backed by image 36e2fb0f-5e44-4490-8115-08f43f26e2a0 with: {'image_id': '36e2fb0f-5e44-4490-8115-08f43f26e2a0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c0b0a2fcea89919b78c9b73902a142c9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87639) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc15ce1-3c2a-49f9-8541-afc3df835603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5', 'volume_size': 1, 'image_id': '36e2fb0f-5e44-4490-8115-08f43f26e2a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/36e2fb0f-5e44-4490-8115-08f43f26e2a0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c0b0a2fcea89919b78c9b73902a142c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6e7d5267b39947bba629b40839b035e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fda1251f920e88f629dd58f020367723a0ec16885909b74a8a1752956089b0516e46b3ecf085fd8f829d614f31b0e4692c170fe0c93934966634e40713aa57db', 'id': '36e2fb0f-5e44-4490-8115-08f43f26e2a0', 'created_at': datetime.datetime(2026, 9, 9, 16, 31, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 31, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/36e2fb0f-5e44-4490-8115-08f43f26e2a0/file', 'properties': {}}, 'image_service': }' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7249c423-c12b-453e-af4e-081a82153924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:31:59 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Volume volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5 (55983b8c-37f3-43a6-afc7-a97d24bf32c5): created successfully Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7249c423-c12b-453e-af4e-081a82153924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Flow 'volume_create_manager' (5786810b-1d43-410d-961e-149ebb1f6790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:31:59 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-c04518da-a744-4f77-a227-49a3a686c95b tempest-VolumeImageDependencyTests-2092301141 None] Created volume successfully. Sep 09 18:31:59 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8fcb39ca-51d1-45be-893b-7517ef0c5452" returned: 0 in 0.658s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_293ecc22-3a06-4631-ae6b-0c54b5dcda33_ru71tg1bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8fcb39ca-51d1-45be-893b-7517ef0c5452 {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:31:59 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Converted 0.00 MB image at 0.00 MB/s Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8fcb39ca-51d1-45be-893b-7517ef0c5452 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:59 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a64acad4-2970-4230-9e13-d1dab8b45158 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-47647674-4f37-457a-acff-0ddd79fede7e" returned: 0 in 0.347s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:31:59 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8fcb39ca-51d1-45be-893b-7517ef0c5452 1G Sep 09 18:31:59 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a64acad4-2970-4230-9e13-d1dab8b45158 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-quobyte-47647674-4f37-457a-acff-0ddd79fede7e" released by "delete_volume" :: held 0.854s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-a64acad4-2970-4230-9e13-d1dab8b45158 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Created reservations ['376e1a2c-1817-4ecb-922a-89a8e807ceb0', 'd5fadc44-bfb8-43a0-a0b5-f26cb6e217d1', 'ca051b58-6343-44ac-91be-00c4bde032c4', '8e43b0d8-99dc-4220-b0a5-b92f333de66d'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a64acad4-2970-4230-9e13-d1dab8b45158 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a64acad4-2970-4230-9e13-d1dab8b45158 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a64acad4-2970-4230-9e13-d1dab8b45158 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a64acad4-2970-4230-9e13-d1dab8b45158 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a64acad4-2970-4230-9e13-d1dab8b45158 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a64acad4-2970-4230-9e13-d1dab8b45158 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:31:59 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:31:59 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1ed1457c-d80a-4c04-96c2-3fc30f947309 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "cinder-df899fb9-42ac-43bd-9586-5e3dc225a0c7-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:31:59 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1ed1457c-d80a-4c04-96c2-3fc30f947309 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-df899fb9-42ac-43bd-9586-5e3dc225a0c7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1ed1457c-d80a-4c04-96c2-3fc30f947309 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "cinder-quobyte-df899fb9-42ac-43bd-9586-5e3dc225a0c7" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1ed1457c-d80a-4c04-96c2-3fc30f947309 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-quobyte-df899fb9-42ac-43bd-9586-5e3dc225a0c7" acquired by "delete_volume" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:00 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8fcb39ca-51d1-45be-893b-7517ef0c5452 1G" returned: 0 in 0.438s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Downloaded image 293ecc22-3a06-4631-ae6b-0c54b5dcda33 ((None, [{'url': 'file:///opt/stack/data/glance/images/293ecc22-3a06-4631-ae6b-0c54b5dcda33', 'metadata': {}}])) to volume 8fcb39ca-51d1-45be-893b-7517ef0c5452 successfully. {{(pid=87639) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Temporary image 293ecc22-3a06-4631-ae6b-0c54b5dcda33 for user 9c2b732aa89743abb6cd791f86322d16 is deleted. {{(pid=87639) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG cinder.volume.volume_utils [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Marking volume 8fcb39ca-51d1-45be-893b-7517ef0c5452 as bootable. {{(pid=87639) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1dc08a-f7ca-4203-bcab-baecd8d9ff62]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1ed1457c-d80a-4c04-96c2-3fc30f947309 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df899fb9-42ac-43bd-9586-5e3dc225a0c7 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Copying metadata from image 293ecc22-3a06-4631-ae6b-0c54b5dcda33 to 8fcb39ca-51d1-45be-893b-7517ef0c5452. {{(pid=87639) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Creating volume glance metadata for volume 8fcb39ca-51d1-45be-893b-7517ef0c5452 backed by image 293ecc22-3a06-4631-ae6b-0c54b5dcda33 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '293ecc22-3a06-4631-ae6b-0c54b5dcda33', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c6f6f73274e3f8593d8c0f74fc4a92b4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87639) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 18:32:00 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a64acad4-2970-4230-9e13-d1dab8b45158 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.332s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-a64acad4-2970-4230-9e13-d1dab8b45158 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:00 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-a64acad4-2970-4230-9e13-d1dab8b45158 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Deleted volume successfully. Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a64acad4-2970-4230-9e13-d1dab8b45158 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-47647674-4f37-457a-acff-0ddd79fede7e-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:00 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df899fb9-42ac-43bd-9586-5e3dc225a0c7 Sep 09 18:32:00 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6530e4c6-bdce-46e4-be7e-2f478c79dff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fcb39ca-51d1-45be-893b-7517ef0c5452', 'volume_size': 1, 'image_id': '293ecc22-3a06-4631-ae6b-0c54b5dcda33', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/293ecc22-3a06-4631-ae6b-0c54b5dcda33', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c6f6f73274e3f8593d8c0f74fc4a92b4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bd0704460ac24c9e999e51b93f5934f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fd173b83158e422e4a14e3cb9c6ceccdd9f7c94db185a536d6fa0a890d1f4f41aa6146691a0a11912253076640cd947df7d09c986c6e0ce532c74f55b252045d', 'id': '293ecc22-3a06-4631-ae6b-0c54b5dcda33', 'created_at': datetime.datetime(2026, 9, 9, 16, 31, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 16, 31, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/293ecc22-3a06-4631-ae6b-0c54b5dcda33/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e9477c7-eefb-4366-871b-44fb11a1f131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:00 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Volume volume-8fcb39ca-51d1-45be-893b-7517ef0c5452 (8fcb39ca-51d1-45be-893b-7517ef0c5452): created successfully Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e9477c7-eefb-4366-871b-44fb11a1f131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Flow 'volume_create_manager' (4eb7d223-9147-44fe-b0f4-f58bfdf768b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:00 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-cad03935-36c5-4179-8552-3dd831ad3540 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Created volume successfully. Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-559bce73-a012-4246-bc80-181e6e241514 tempest-VolumeImageDependencyTests-2092301141 None] Acquiring lock "cinder-55983b8c-37f3-43a6-afc7-a97d24bf32c5-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-559bce73-a012-4246-bc80-181e6e241514 tempest-VolumeImageDependencyTests-2092301141 None] Lock "cinder-55983b8c-37f3-43a6-afc7-a97d24bf32c5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-559bce73-a012-4246-bc80-181e6e241514 tempest-VolumeImageDependencyTests-2092301141 None] Acquiring lock "cinder-quobyte-55983b8c-37f3-43a6-afc7-a97d24bf32c5" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-559bce73-a012-4246-bc80-181e6e241514 tempest-VolumeImageDependencyTests-2092301141 None] Lock "cinder-quobyte-55983b8c-37f3-43a6-afc7-a97d24bf32c5" acquired by "delete_volume" :: waited 0.026s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a0ca5a-8d8f-408f-bb62-eab35d495731]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-559bce73-a012-4246-bc80-181e6e241514 tempest-VolumeImageDependencyTests-2092301141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:00 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1ed1457c-d80a-4c04-96c2-3fc30f947309 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df899fb9-42ac-43bd-9586-5e3dc225a0c7" returned: 0 in 0.461s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1ed1457c-d80a-4c04-96c2-3fc30f947309 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df899fb9-42ac-43bd-9586-5e3dc225a0c7 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:00 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df899fb9-42ac-43bd-9586-5e3dc225a0c7 Sep 09 18:32:00 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c5a0d296-7b7f-443e-a49a-f15b66bc01d7 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Acquiring lock "cinder-8fcb39ca-51d1-45be-893b-7517ef0c5452-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:00 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5 Sep 09 18:32:00 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c5a0d296-7b7f-443e-a49a-f15b66bc01d7 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Lock "cinder-8fcb39ca-51d1-45be-893b-7517ef0c5452-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c5a0d296-7b7f-443e-a49a-f15b66bc01d7 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Acquiring lock "cinder-quobyte-8fcb39ca-51d1-45be-893b-7517ef0c5452" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c5a0d296-7b7f-443e-a49a-f15b66bc01d7 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Lock "cinder-quobyte-8fcb39ca-51d1-45be-893b-7517ef0c5452" acquired by "delete_volume" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f7d0f1-1b5e-4ddc-83d9-c626e5e0a110]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c5a0d296-7b7f-443e-a49a-f15b66bc01d7 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8fcb39ca-51d1-45be-893b-7517ef0c5452 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:00 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:00 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8fcb39ca-51d1-45be-893b-7517ef0c5452 Sep 09 18:32:00 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1ed1457c-d80a-4c04-96c2-3fc30f947309 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-df899fb9-42ac-43bd-9586-5e3dc225a0c7" returned: 0 in 0.388s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1ed1457c-d80a-4c04-96c2-3fc30f947309 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-quobyte-df899fb9-42ac-43bd-9586-5e3dc225a0c7" released by "delete_volume" :: held 0.926s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:00 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-559bce73-a012-4246-bc80-181e6e241514 tempest-VolumeImageDependencyTests-2092301141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5" returned: 0 in 0.456s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-559bce73-a012-4246-bc80-181e6e241514 tempest-VolumeImageDependencyTests-2092301141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:01 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5 Sep 09 18:32:01 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-1ed1457c-d80a-4c04-96c2-3fc30f947309 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Created reservations ['b53a624c-c56e-401a-8166-ae7628ec6919', '69cbdc35-7dfa-4595-a6d3-954c96484a4e', 'b153f9fc-99c4-4ccd-962b-afaebf706663', 'e3d519e5-4cd4-456b-b442-d695b71d2872'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1ed1457c-d80a-4c04-96c2-3fc30f947309 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1ed1457c-d80a-4c04-96c2-3fc30f947309 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1ed1457c-d80a-4c04-96c2-3fc30f947309 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1ed1457c-d80a-4c04-96c2-3fc30f947309 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1ed1457c-d80a-4c04-96c2-3fc30f947309 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1ed1457c-d80a-4c04-96c2-3fc30f947309 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:01 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:01 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:01 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c5a0d296-7b7f-443e-a49a-f15b66bc01d7 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8fcb39ca-51d1-45be-893b-7517ef0c5452" returned: 0 in 0.460s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c5a0d296-7b7f-443e-a49a-f15b66bc01d7 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8fcb39ca-51d1-45be-893b-7517ef0c5452 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:01 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8fcb39ca-51d1-45be-893b-7517ef0c5452 Sep 09 18:32:01 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:01 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-559bce73-a012-4246-bc80-181e6e241514 tempest-VolumeImageDependencyTests-2092301141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-55983b8c-37f3-43a6-afc7-a97d24bf32c5" returned: 0 in 0.373s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-559bce73-a012-4246-bc80-181e6e241514 tempest-VolumeImageDependencyTests-2092301141 None] Lock "cinder-quobyte-55983b8c-37f3-43a6-afc7-a97d24bf32c5" released by "delete_volume" :: held 0.883s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-559bce73-a012-4246-bc80-181e6e241514 tempest-VolumeImageDependencyTests-2092301141 None] Created reservations ['9cf41459-b442-4e75-88b4-61d7cf8befc3', 'f67a06f1-ac74-44c8-8c6c-aaebff9503af', 'bc98c6b9-b90d-41a4-a06b-0551a6397687', 'fe59a4f1-38b9-4126-b37e-425c59123a91'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-559bce73-a012-4246-bc80-181e6e241514 tempest-VolumeImageDependencyTests-2092301141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:01 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-559bce73-a012-4246-bc80-181e6e241514 tempest-VolumeImageDependencyTests-2092301141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-559bce73-a012-4246-bc80-181e6e241514 tempest-VolumeImageDependencyTests-2092301141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-559bce73-a012-4246-bc80-181e6e241514 tempest-VolumeImageDependencyTests-2092301141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-559bce73-a012-4246-bc80-181e6e241514 tempest-VolumeImageDependencyTests-2092301141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-559bce73-a012-4246-bc80-181e6e241514 tempest-VolumeImageDependencyTests-2092301141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1ed1457c-d80a-4c04-96c2-3fc30f947309 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.340s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-1ed1457c-d80a-4c04-96c2-3fc30f947309 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:01 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-1ed1457c-d80a-4c04-96c2-3fc30f947309 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Deleted volume successfully. Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1ed1457c-d80a-4c04-96c2-3fc30f947309 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-df899fb9-42ac-43bd-9586-5e3dc225a0c7-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:01 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:01 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:01 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c5a0d296-7b7f-443e-a49a-f15b66bc01d7 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8fcb39ca-51d1-45be-893b-7517ef0c5452" returned: 0 in 0.388s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c5a0d296-7b7f-443e-a49a-f15b66bc01d7 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Lock "cinder-quobyte-8fcb39ca-51d1-45be-893b-7517ef0c5452" released by "delete_volume" :: held 0.922s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-c5a0d296-7b7f-443e-a49a-f15b66bc01d7 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Created reservations ['dc37c8c8-b771-4d0a-9285-9852e70cbb20', '7b699d89-080b-4345-81e1-10a039800b05', '69a8c3c9-a3f7-4b9a-8b7f-0cdeb6ba63d7', 'df9dadaf-5815-46fb-b75f-7b0d0824c614'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c5a0d296-7b7f-443e-a49a-f15b66bc01d7 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c5a0d296-7b7f-443e-a49a-f15b66bc01d7 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c5a0d296-7b7f-443e-a49a-f15b66bc01d7 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c5a0d296-7b7f-443e-a49a-f15b66bc01d7 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c5a0d296-7b7f-443e-a49a-f15b66bc01d7 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c5a0d296-7b7f-443e-a49a-f15b66bc01d7 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:01 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:01 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:01 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-559bce73-a012-4246-bc80-181e6e241514 tempest-VolumeImageDependencyTests-2092301141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.399s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-559bce73-a012-4246-bc80-181e6e241514 tempest-VolumeImageDependencyTests-2092301141 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:01 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-559bce73-a012-4246-bc80-181e6e241514 tempest-VolumeImageDependencyTests-2092301141 None] Deleted volume successfully. Sep 09 18:32:01 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-559bce73-a012-4246-bc80-181e6e241514 tempest-VolumeImageDependencyTests-2092301141 None] Lock "cinder-55983b8c-37f3-43a6-afc7-a97d24bf32c5-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:02 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c5a0d296-7b7f-443e-a49a-f15b66bc01d7 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.301s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:02 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-c5a0d296-7b7f-443e-a49a-f15b66bc01d7 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:02 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-c5a0d296-7b7f-443e-a49a-f15b66bc01d7 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Deleted volume successfully. Sep 09 18:32:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c5a0d296-7b7f-443e-a49a-f15b66bc01d7 tempest-VolumeAndVolumeTypeFromImageTest-1287335007 None] Lock "cinder-8fcb39ca-51d1-45be-893b-7517ef0c5452-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2a5abf9e-180a-40e1-8220-822b6205c882 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "cinder-de693157-ee7e-439d-a29a-3cba078fe1d6-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2a5abf9e-180a-40e1-8220-822b6205c882 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-de693157-ee7e-439d-a29a-3cba078fe1d6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2a5abf9e-180a-40e1-8220-822b6205c882 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "cinder-quobyte-de693157-ee7e-439d-a29a-3cba078fe1d6" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2a5abf9e-180a-40e1-8220-822b6205c882 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-quobyte-de693157-ee7e-439d-a29a-3cba078fe1d6" acquired by "delete_volume" :: waited 0.027s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:02 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eedc91f-3805-4471-9433-97692d71b001]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a5abf9e-180a-40e1-8220-822b6205c882 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-de693157-ee7e-439d-a29a-3cba078fe1d6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:02 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-de693157-ee7e-439d-a29a-3cba078fe1d6 Sep 09 18:32:02 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:02 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a5abf9e-180a-40e1-8220-822b6205c882 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-de693157-ee7e-439d-a29a-3cba078fe1d6" returned: 0 in 0.447s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a5abf9e-180a-40e1-8220-822b6205c882 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-de693157-ee7e-439d-a29a-3cba078fe1d6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:02 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-de693157-ee7e-439d-a29a-3cba078fe1d6 Sep 09 18:32:02 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:03 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a5abf9e-180a-40e1-8220-822b6205c882 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-de693157-ee7e-439d-a29a-3cba078fe1d6" returned: 0 in 0.371s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2a5abf9e-180a-40e1-8220-822b6205c882 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-quobyte-de693157-ee7e-439d-a29a-3cba078fe1d6" released by "delete_volume" :: held 0.872s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:03 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-2a5abf9e-180a-40e1-8220-822b6205c882 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Created reservations ['b089b7fc-9773-4c04-b247-33a329dad88b', '8aa93f63-351e-4452-b4a0-f3480ab085d8', 'c4ee6526-6dc1-45e1-be4c-703728163eca', 'f44026df-e8bf-4cc3-8204-90982286d1f6'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2a5abf9e-180a-40e1-8220-822b6205c882 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2a5abf9e-180a-40e1-8220-822b6205c882 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2a5abf9e-180a-40e1-8220-822b6205c882 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2a5abf9e-180a-40e1-8220-822b6205c882 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2a5abf9e-180a-40e1-8220-822b6205c882 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a5abf9e-180a-40e1-8220-822b6205c882 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:03 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:03 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ef0d4c28-be22-498d-af75-593b253946d4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "cinder-eb8748a6-3caa-4bd0-9771-caf4703e1f7e-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ef0d4c28-be22-498d-af75-593b253946d4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-eb8748a6-3caa-4bd0-9771-caf4703e1f7e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ef0d4c28-be22-498d-af75-593b253946d4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "cinder-quobyte-eb8748a6-3caa-4bd0-9771-caf4703e1f7e" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ef0d4c28-be22-498d-af75-593b253946d4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-quobyte-eb8748a6-3caa-4bd0-9771-caf4703e1f7e" acquired by "delete_volume" :: waited 0.029s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:03 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f8dba1-41a2-4f0a-9351-9610a23ce711]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ef0d4c28-be22-498d-af75-593b253946d4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-eb8748a6-3caa-4bd0-9771-caf4703e1f7e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:03 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a5abf9e-180a-40e1-8220-822b6205c882 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.399s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:03 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-2a5abf9e-180a-40e1-8220-822b6205c882 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:03 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-2a5abf9e-180a-40e1-8220-822b6205c882 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Deleted volume successfully. Sep 09 18:32:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2a5abf9e-180a-40e1-8220-822b6205c882 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-de693157-ee7e-439d-a29a-3cba078fe1d6-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:03 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-eb8748a6-3caa-4bd0-9771-caf4703e1f7e Sep 09 18:32:03 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:04 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ef0d4c28-be22-498d-af75-593b253946d4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-eb8748a6-3caa-4bd0-9771-caf4703e1f7e" returned: 0 in 0.444s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ef0d4c28-be22-498d-af75-593b253946d4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-eb8748a6-3caa-4bd0-9771-caf4703e1f7e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:04 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-eb8748a6-3caa-4bd0-9771-caf4703e1f7e Sep 09 18:32:04 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:04 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ef0d4c28-be22-498d-af75-593b253946d4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-eb8748a6-3caa-4bd0-9771-caf4703e1f7e" returned: 0 in 0.268s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ef0d4c28-be22-498d-af75-593b253946d4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-quobyte-eb8748a6-3caa-4bd0-9771-caf4703e1f7e" released by "delete_volume" :: held 0.767s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:04 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-ef0d4c28-be22-498d-af75-593b253946d4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Created reservations ['fa0715f8-4c34-4d96-9dab-cf78e3b39fac', '8fc63d75-7aaa-490d-a0dc-43380fb6ed08', '469ecae7-87dc-45d9-b18f-56776e00f20f', 'eb6ceb7e-e01a-4931-9d10-2c81d293caa3'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ef0d4c28-be22-498d-af75-593b253946d4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ef0d4c28-be22-498d-af75-593b253946d4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:04 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d4c28-be22-498d-af75-593b253946d4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:04 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d4c28-be22-498d-af75-593b253946d4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ef0d4c28-be22-498d-af75-593b253946d4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ef0d4c28-be22-498d-af75-593b253946d4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:04 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:04 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1624109e-8ab8-40c0-ac47-1af589873969 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "cinder-cd27ee87-60c7-42ba-9c77-6e09c3944c8e-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1624109e-8ab8-40c0-ac47-1af589873969 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-cd27ee87-60c7-42ba-9c77-6e09c3944c8e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:04 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ef0d4c28-be22-498d-af75-593b253946d4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.339s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:04 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-ef0d4c28-be22-498d-af75-593b253946d4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:04 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ef0d4c28-be22-498d-af75-593b253946d4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Deleted volume successfully. Sep 09 18:32:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1624109e-8ab8-40c0-ac47-1af589873969 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "cinder-quobyte-cd27ee87-60c7-42ba-9c77-6e09c3944c8e" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ef0d4c28-be22-498d-af75-593b253946d4 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-eb8748a6-3caa-4bd0-9771-caf4703e1f7e-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1624109e-8ab8-40c0-ac47-1af589873969 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-quobyte-cd27ee87-60c7-42ba-9c77-6e09c3944c8e" acquired by "delete_volume" :: waited 0.045s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:05 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1c3e81-aeaa-4b34-abf5-d0cb705aff84]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1624109e-8ab8-40c0-ac47-1af589873969 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cd27ee87-60c7-42ba-9c77-6e09c3944c8e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:05 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cd27ee87-60c7-42ba-9c77-6e09c3944c8e Sep 09 18:32:05 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:05 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1624109e-8ab8-40c0-ac47-1af589873969 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cd27ee87-60c7-42ba-9c77-6e09c3944c8e" returned: 0 in 0.482s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1624109e-8ab8-40c0-ac47-1af589873969 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cd27ee87-60c7-42ba-9c77-6e09c3944c8e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:05 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cd27ee87-60c7-42ba-9c77-6e09c3944c8e Sep 09 18:32:05 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:05 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1624109e-8ab8-40c0-ac47-1af589873969 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-cd27ee87-60c7-42ba-9c77-6e09c3944c8e" returned: 0 in 0.334s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1624109e-8ab8-40c0-ac47-1af589873969 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-quobyte-cd27ee87-60c7-42ba-9c77-6e09c3944c8e" released by "delete_volume" :: held 0.875s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:05 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-1624109e-8ab8-40c0-ac47-1af589873969 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Created reservations ['6c3b7fc2-5646-43a0-926c-0ebc2cf4fd59', 'b147f131-ac80-4840-9c4c-cc6a18546165', '74f555d1-4bab-4ab1-a0a3-dcaba6c69fa8', '4b6b47b3-15cb-475c-bf2c-7ce727efd5ca'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1624109e-8ab8-40c0-ac47-1af589873969 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1624109e-8ab8-40c0-ac47-1af589873969 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1624109e-8ab8-40c0-ac47-1af589873969 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1624109e-8ab8-40c0-ac47-1af589873969 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1624109e-8ab8-40c0-ac47-1af589873969 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1624109e-8ab8-40c0-ac47-1af589873969 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:06 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:06 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:06 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1624109e-8ab8-40c0-ac47-1af589873969 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.446s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-1624109e-8ab8-40c0-ac47-1af589873969 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:06 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-1624109e-8ab8-40c0-ac47-1af589873969 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Deleted volume successfully. Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1624109e-8ab8-40c0-ac47-1af589873969 tempest-CreateVolumesFromSourceVolumeTest-1537377588 None] Lock "cinder-cd27ee87-60c7-42ba-9c77-6e09c3944c8e-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Flow 'volume_create_manager' (7e5a2487-2cfc-4ade-bcf6-cb226867b125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (972e1927-1d26-4439-a94a-c5a882fe0e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (972e1927-1d26-4439-a94a-c5a882fe0e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e000e7-cf51-436a-937a-1f9c98835b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6badb6ecfbf648fb8c6e098f72df6d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:07Z,use_quota=True,user_id='47df505982b4456abba6514a4fd4b235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a790186-dd5b-4fd4-b6bd-a69f1ab68090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a790186-dd5b-4fd4-b6bd-a69f1ab68090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef5d3fb-b298-486f-af0a-ec9abdd80a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aef5d3fb-b298-486f-af0a-ec9abdd80a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70e000e7-cf51-436a-937a-1f9c98835b2d', 'volume_name': 'volume-70e000e7-cf51-436a-937a-1f9c98835b2d', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c41d74-d29f-4651-bfe2-3e9a4b3df0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22c41d74-d29f-4651-bfe2-3e9a4b3df0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77c6972-de46-41dc-a24a-fecb6341b878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:06 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Volume 70e000e7-cf51-436a-937a-1f9c98835b2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70e000e7-cf51-436a-937a-1f9c98835b2d', 'volume_size': 1} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e000e7-cf51-436a-937a-1f9c98835b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6badb6ecfbf648fb8c6e098f72df6d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:07Z,use_quota=True,user_id='47df505982b4456abba6514a4fd4b235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Creating volume 70e000e7-cf51-436a-937a-1f9c98835b2d {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:32:06 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70e000e7-cf51-436a-937a-1f9c98835b2d 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:06 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70e000e7-cf51-436a-937a-1f9c98835b2d 1073741824 Sep 09 18:32:06 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Flow 'volume_create_manager' (976e4d58-dd06-42aa-9482-43f42e411cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033247f6-e7b3-4a6e-a46c-b2ac3f8be798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033247f6-e7b3-4a6e-a46c-b2ac3f8be798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-237404930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c049ea38-aa9d-4004-9366-1619f98fe2c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0a90f769854aa2b8b8a38bcd5b296d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:07Z,use_quota=True,user_id='54251b06493f44ea8a1ddeab5f40dd28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9749dd-a7ed-4140-9f8e-22cdba5f7754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9749dd-a7ed-4140-9f8e-22cdba5f7754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dbdb8cf-01f4-48f8-a212-7a911bfeb366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dbdb8cf-01f4-48f8-a212-7a911bfeb366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c049ea38-aa9d-4004-9366-1619f98fe2c6', 'volume_name': 'volume-c049ea38-aa9d-4004-9366-1619f98fe2c6', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654ae596-471b-4f3b-b533-0811d17de2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654ae596-471b-4f3b-b533-0811d17de2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a9a22f-98cc-4268-a6f6-c68701591b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:07 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Volume c049ea38-aa9d-4004-9366-1619f98fe2c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c049ea38-aa9d-4004-9366-1619f98fe2c6', 'volume_size': 1} Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:07 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70e000e7-cf51-436a-937a-1f9c98835b2d 1073741824" returned: 0 in 0.632s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70e000e7-cf51-436a-937a-1f9c98835b2d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:07 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70e000e7-cf51-436a-937a-1f9c98835b2d Sep 09 18:32:07 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:07 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70e000e7-cf51-436a-937a-1f9c98835b2d" returned: 0 in 0.276s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.607s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-237404930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c049ea38-aa9d-4004-9366-1619f98fe2c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0a90f769854aa2b8b8a38bcd5b296d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:07Z,use_quota=True,user_id='54251b06493f44ea8a1ddeab5f40dd28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Creating volume c049ea38-aa9d-4004-9366-1619f98fe2c6 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:32:07 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c049ea38-aa9d-4004-9366-1619f98fe2c6 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:07 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c049ea38-aa9d-4004-9366-1619f98fe2c6 1073741824 Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77c6972-de46-41dc-a24a-fecb6341b878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70e000e7-cf51-436a-937a-1f9c98835b2d', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:07 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee65471-ae03-425f-9e14-68240dbd6ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:07 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Volume volume-70e000e7-cf51-436a-937a-1f9c98835b2d (70e000e7-cf51-436a-937a-1f9c98835b2d): created successfully Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee65471-ae03-425f-9e14-68240dbd6ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Flow 'volume_create_manager' (7e5a2487-2cfc-4ade-bcf6-cb226867b125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:07 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-cd9e6987-9d8a-4168-a76c-6d824b26eeb7 tempest-CinderUnicodeTest-332552882 None] Created volume successfully. Sep 09 18:32:08 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c049ea38-aa9d-4004-9366-1619f98fe2c6 1073741824" returned: 0 in 0.632s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c049ea38-aa9d-4004-9366-1619f98fe2c6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:08 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c049ea38-aa9d-4004-9366-1619f98fe2c6 Sep 09 18:32:08 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:08 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c049ea38-aa9d-4004-9366-1619f98fe2c6" returned: 0 in 0.319s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:32:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a9a22f-98cc-4268-a6f6-c68701591b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c049ea38-aa9d-4004-9366-1619f98fe2c6', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c926f06-afb4-4937-956f-bdcdb3d6d752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:08 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Volume volume-c049ea38-aa9d-4004-9366-1619f98fe2c6 (c049ea38-aa9d-4004-9366-1619f98fe2c6): created successfully Sep 09 18:32:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c926f06-afb4-4937-956f-bdcdb3d6d752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Flow 'volume_create_manager' (976e4d58-dd06-42aa-9482-43f42e411cf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:08 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-23280cbb-a51d-446e-850f-4d712e580440 tempest-ProjectReaderTests-673545270 None] Created volume successfully. Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Flow 'volume_create_manager' (2caf3519-25db-4249-9bfc-080f3707cfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7be2c5-c823-469f-a162-b427577a0afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7be2c5-c823-469f-a162-b427577a0afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-835254426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14444130-82b6-408e-9c33-3a7410cebe6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6badb6ecfbf648fb8c6e098f72df6d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:09Z,use_quota=True,user_id='47df505982b4456abba6514a4fd4b235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d585c07-06b6-480f-847f-b4d40e51ef28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d585c07-06b6-480f-847f-b4d40e51ef28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6603a188-e1a1-475e-8d87-539220d5598f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6603a188-e1a1-475e-8d87-539220d5598f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14444130-82b6-408e-9c33-3a7410cebe6f', 'volume_name': 'volume-14444130-82b6-408e-9c33-3a7410cebe6f', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d29574-fec3-4323-b0e9-c2ffb5ac5038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d29574-fec3-4323-b0e9-c2ffb5ac5038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f5a6a9-1b76-4bf8-b638-0a5e607611e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:09 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Volume 14444130-82b6-408e-9c33-3a7410cebe6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14444130-82b6-408e-9c33-3a7410cebe6f', 'volume_size': 1} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-835254426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14444130-82b6-408e-9c33-3a7410cebe6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6badb6ecfbf648fb8c6e098f72df6d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:09Z,use_quota=True,user_id='47df505982b4456abba6514a4fd4b235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Creating volume 14444130-82b6-408e-9c33-3a7410cebe6f {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:32:09 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c380c4a8-0588-42a0-bfa9-4d6526456409 tempest-ProjectReaderTests-673545270 None] Acquiring lock "cinder-c049ea38-aa9d-4004-9366-1619f98fe2c6-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:32:09 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f 1073741824 Sep 09 18:32:09 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Flow 'volume_create_manager' (320bda65-169e-4798-8f53-0808e369fd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f71847-2a11-45e8-9b22-d14000d7fc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c380c4a8-0588-42a0-bfa9-4d6526456409 tempest-ProjectReaderTests-673545270 None] Lock "cinder-c049ea38-aa9d-4004-9366-1619f98fe2c6-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f71847-2a11-45e8-9b22-d14000d7fc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-329542204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ae6766d-e60d-4d38-9b87-8fe106ce3d2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46612cc1d46c470eaf454ae08ef4d982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:09Z,use_quota=True,user_id='38a7bf9e73bf43cea44a8b1bf09e437c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bc749e-302a-4bf6-80a7-eb5d9a4a5f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48bc749e-302a-4bf6-80a7-eb5d9a4a5f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960314fb-89f5-40e5-8734-c1db728b5982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (960314fb-89f5-40e5-8734-c1db728b5982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ae6766d-e60d-4d38-9b87-8fe106ce3d2d', 'volume_name': 'volume-7ae6766d-e60d-4d38-9b87-8fe106ce3d2d', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32fbd156-22f7-40aa-9f77-04f068dacbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32fbd156-22f7-40aa-9f77-04f068dacbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e91e8a-5a5c-47c9-8ad2-5286019dd4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:09 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Volume 7ae6766d-e60d-4d38-9b87-8fe106ce3d2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ae6766d-e60d-4d38-9b87-8fe106ce3d2d', 'volume_size': 1} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Flow 'volume_create_manager' (34e0ae55-5e3a-4f76-b80a-577c0d6e44b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c254af5-e19a-42ba-a685-d65afb4df157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c380c4a8-0588-42a0-bfa9-4d6526456409 tempest-ProjectReaderTests-673545270 None] Acquiring lock "cinder-quobyte-c049ea38-aa9d-4004-9366-1619f98fe2c6" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c254af5-e19a-42ba-a685-d65afb4df157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1420523134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732d02e8-559b-4714-97f7-d89cdaa3fad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46612cc1d46c470eaf454ae08ef4d982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:10Z,use_quota=True,user_id='38a7bf9e73bf43cea44a8b1bf09e437c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b94cedd-f4a5-4dff-9a71-ebdbcc8a0fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b94cedd-f4a5-4dff-9a71-ebdbcc8a0fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15380046-1de5-47ec-8fc3-8a8d7b203d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15380046-1de5-47ec-8fc3-8a8d7b203d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '732d02e8-559b-4714-97f7-d89cdaa3fad3', 'volume_name': 'volume-732d02e8-559b-4714-97f7-d89cdaa3fad3', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30cde9ba-6385-499c-992b-ba88e6641bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30cde9ba-6385-499c-992b-ba88e6641bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a375f6f-9b49-4c1e-ab36-c04862ba6005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:09 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Volume 732d02e8-559b-4714-97f7-d89cdaa3fad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-732d02e8-559b-4714-97f7-d89cdaa3fad3', 'volume_size': 1} Sep 09 18:32:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c380c4a8-0588-42a0-bfa9-4d6526456409 tempest-ProjectReaderTests-673545270 None] Lock "cinder-quobyte-c049ea38-aa9d-4004-9366-1619f98fe2c6" acquired by "delete_volume" :: waited 0.123s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[039d212a-c7c3-4dc7-8b35-7ea7351a2d77]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c380c4a8-0588-42a0-bfa9-4d6526456409 tempest-ProjectReaderTests-673545270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c049ea38-aa9d-4004-9366-1619f98fe2c6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Flow 'volume_create_manager' (c084c5d3-5fca-4e34-b7a0-c9b9b84faa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1472afeb-5a29-4de4-a4d2-06539b386b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1472afeb-5a29-4de4-a4d2-06539b386b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-144197406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015c7c78-d87a-421b-9975-855ff1a7643b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00235c4984e948919d166211e5f779d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:10Z,use_quota=True,user_id='e7dea205007a4239a482a1fa7d0a1ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dbd4ab1-431f-44a6-a15f-fe67c7e8de1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dbd4ab1-431f-44a6-a15f-fe67c7e8de1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f41bed1-6d4f-4bfc-9e6d-5a7c6b1a957f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f41bed1-6d4f-4bfc-9e6d-5a7c6b1a957f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '015c7c78-d87a-421b-9975-855ff1a7643b', 'volume_name': 'volume-015c7c78-d87a-421b-9975-855ff1a7643b', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260d1557-ea57-4024-93bd-4ccdf0a85c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260d1557-ea57-4024-93bd-4ccdf0a85c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:10 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c049ea38-aa9d-4004-9366-1619f98fe2c6 Sep 09 18:32:10 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82fdab2c-a3b4-4834-aac6-8c2a8addc9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:10 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Volume 015c7c78-d87a-421b-9975-855ff1a7643b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-015c7c78-d87a-421b-9975-855ff1a7643b', 'volume_size': 1} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:10 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f 1073741824" returned: 0 in 0.706s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:32:10 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f Sep 09 18:32:10 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Flow 'volume_create_manager' (40e05b56-20e6-4c8f-8fe1-6f584967bdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2496c4cd-d53b-4b46-b7de-214e4036172d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2496c4cd-d53b-4b46-b7de-214e4036172d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1519447837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe15f3a-eae1-4e3d-b425-59433b5ae49b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46612cc1d46c470eaf454ae08ef4d982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:10Z,use_quota=True,user_id='38a7bf9e73bf43cea44a8b1bf09e437c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fcb042-55dd-4336-b32d-f185b45f6d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fcb042-55dd-4336-b32d-f185b45f6d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf4d010-602f-49f8-a9a7-83196aa6fedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf4d010-602f-49f8-a9a7-83196aa6fedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efe15f3a-eae1-4e3d-b425-59433b5ae49b', 'volume_name': 'volume-efe15f3a-eae1-4e3d-b425-59433b5ae49b', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c67703-4cfd-4f93-a4b8-35447fa7659f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c67703-4cfd-4f93-a4b8-35447fa7659f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0055f21b-797e-42d9-9ad1-3a89185dae91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:10 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Volume efe15f3a-eae1-4e3d-b425-59433b5ae49b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efe15f3a-eae1-4e3d-b425-59433b5ae49b', 'volume_size': 1} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:10 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c380c4a8-0588-42a0-bfa9-4d6526456409 tempest-ProjectReaderTests-673545270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c049ea38-aa9d-4004-9366-1619f98fe2c6" returned: 0 in 0.505s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c380c4a8-0588-42a0-bfa9-4d6526456409 tempest-ProjectReaderTests-673545270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c049ea38-aa9d-4004-9366-1619f98fe2c6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:10 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c049ea38-aa9d-4004-9366-1619f98fe2c6 Sep 09 18:32:10 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:10 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f" returned: 0 in 0.375s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.967s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-329542204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ae6766d-e60d-4d38-9b87-8fe106ce3d2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46612cc1d46c470eaf454ae08ef4d982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:09Z,use_quota=True,user_id='38a7bf9e73bf43cea44a8b1bf09e437c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Creating volume 7ae6766d-e60d-4d38-9b87-8fe106ce3d2d {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:32:10 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ae6766d-e60d-4d38-9b87-8fe106ce3d2d 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f5a6a9-1b76-4bf8-b638-0a5e607611e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14444130-82b6-408e-9c33-3a7410cebe6f', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ab1ccd-f10a-4f82-889e-122f42b5cf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:10 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ae6766d-e60d-4d38-9b87-8fe106ce3d2d 1073741824 Sep 09 18:32:10 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:10 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Volume volume-14444130-82b6-408e-9c33-3a7410cebe6f (14444130-82b6-408e-9c33-3a7410cebe6f): created successfully Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ab1ccd-f10a-4f82-889e-122f42b5cf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Flow 'volume_create_manager' (2caf3519-25db-4249-9bfc-080f3707cfa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:32:10 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Flow 'volume_create_manager' (757c2b03-0b75-4d84-9eab-379ea076cfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9120959b-fb81-44db-bad7-a1c82f69173a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c380c4a8-0588-42a0-bfa9-4d6526456409 tempest-ProjectReaderTests-673545270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-c049ea38-aa9d-4004-9366-1619f98fe2c6" returned: 0 in 0.314s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c380c4a8-0588-42a0-bfa9-4d6526456409 tempest-ProjectReaderTests-673545270 None] Lock "cinder-quobyte-c049ea38-aa9d-4004-9366-1619f98fe2c6" released by "delete_volume" :: held 0.886s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:10 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-2e39368e-7ef3-4ae2-9a47-f671cbbd5cbb tempest-CinderUnicodeTest-332552882 None] Created volume successfully. Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9120959b-fb81-44db-bad7-a1c82f69173a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-453849421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed58502-b97a-492d-bb19-bc107a8281d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46612cc1d46c470eaf454ae08ef4d982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:11Z,use_quota=True,user_id='38a7bf9e73bf43cea44a8b1bf09e437c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ddfbb1-2167-453f-a8c3-cf06021ab7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ddfbb1-2167-453f-a8c3-cf06021ab7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9bc86da-db37-4a0b-a016-831fe3817c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9bc86da-db37-4a0b-a016-831fe3817c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ed58502-b97a-492d-bb19-bc107a8281d0', 'volume_name': 'volume-3ed58502-b97a-492d-bb19-bc107a8281d0', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ffa7d2e-a849-43f3-9f5b-92f208fc2320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ffa7d2e-a849-43f3-9f5b-92f208fc2320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22f6dfa-e381-4718-8011-18edf8c6097f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:10 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Volume 3ed58502-b97a-492d-bb19-bc107a8281d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ed58502-b97a-492d-bb19-bc107a8281d0', 'volume_size': 1} Sep 09 18:32:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-c380c4a8-0588-42a0-bfa9-4d6526456409 tempest-ProjectReaderTests-673545270 None] Created reservations ['5f149125-715a-4de9-998a-70712b0da087', '83e2bcf9-364f-483d-88be-3da41a8e56e7', 'e8f687f7-5906-469b-9f28-7bab629901a5', '52e87167-70aa-4a38-82b4-af3debecb68c'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c380c4a8-0588-42a0-bfa9-4d6526456409 tempest-ProjectReaderTests-673545270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c380c4a8-0588-42a0-bfa9-4d6526456409 tempest-ProjectReaderTests-673545270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c380c4a8-0588-42a0-bfa9-4d6526456409 tempest-ProjectReaderTests-673545270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-c380c4a8-0588-42a0-bfa9-4d6526456409 tempest-ProjectReaderTests-673545270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c380c4a8-0588-42a0-bfa9-4d6526456409 tempest-ProjectReaderTests-673545270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c380c4a8-0588-42a0-bfa9-4d6526456409 tempest-ProjectReaderTests-673545270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:11 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:11 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Flow 'volume_create_manager' (5c246cf8-8ed2-427a-b936-3dee8fd39155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb84ad72-9361-4cc9-a6fa-e5cec556c4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb84ad72-9361-4cc9-a6fa-e5cec556c4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1261695853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c8b823-66d4-455f-a66a-6758d0a5360c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46612cc1d46c470eaf454ae08ef4d982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:11Z,use_quota=True,user_id='38a7bf9e73bf43cea44a8b1bf09e437c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eeb7754-c9e8-451d-830a-5519cb1c71b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eeb7754-c9e8-451d-830a-5519cb1c71b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d358a069-1b27-4823-8dc5-41dc065fb864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d358a069-1b27-4823-8dc5-41dc065fb864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4c8b823-66d4-455f-a66a-6758d0a5360c', 'volume_name': 'volume-d4c8b823-66d4-455f-a66a-6758d0a5360c', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b715ed-fc2c-4040-830e-aa3b03bf80ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41b715ed-fc2c-4040-830e-aa3b03bf80ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a603e1e9-ec7c-4d4d-b138-9965a9c147c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:11 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Volume d4c8b823-66d4-455f-a66a-6758d0a5360c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4c8b823-66d4-455f-a66a-6758d0a5360c', 'volume_size': 1} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:11 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ae6766d-e60d-4d38-9b87-8fe106ce3d2d 1073741824" returned: 0 in 0.568s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ae6766d-e60d-4d38-9b87-8fe106ce3d2d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:11 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ae6766d-e60d-4d38-9b87-8fe106ce3d2d Sep 09 18:32:11 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:11 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c380c4a8-0588-42a0-bfa9-4d6526456409 tempest-ProjectReaderTests-673545270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.292s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-c380c4a8-0588-42a0-bfa9-4d6526456409 tempest-ProjectReaderTests-673545270 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:11 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-c380c4a8-0588-42a0-bfa9-4d6526456409 tempest-ProjectReaderTests-673545270 None] Deleted volume successfully. Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c380c4a8-0588-42a0-bfa9-4d6526456409 tempest-ProjectReaderTests-673545270 None] Lock "cinder-c049ea38-aa9d-4004-9366-1619f98fe2c6-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:11 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ae6766d-e60d-4d38-9b87-8fe106ce3d2d" returned: 0 in 0.271s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.642s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1420523134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732d02e8-559b-4714-97f7-d89cdaa3fad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46612cc1d46c470eaf454ae08ef4d982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:10Z,use_quota=True,user_id='38a7bf9e73bf43cea44a8b1bf09e437c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Creating volume 732d02e8-559b-4714-97f7-d89cdaa3fad3 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:32:11 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-732d02e8-559b-4714-97f7-d89cdaa3fad3 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:11 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-732d02e8-559b-4714-97f7-d89cdaa3fad3 1073741824 Sep 09 18:32:11 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e91e8a-5a5c-47c9-8ad2-5286019dd4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ae6766d-e60d-4d38-9b87-8fe106ce3d2d', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30bfbfc6-e717-452b-b9eb-ee12180e836e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-aa8b58e1-87fa-4be6-a7b8-c1f4d1233b01 tempest-CinderUnicodeTest-332552882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:11 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Volume volume-7ae6766d-e60d-4d38-9b87-8fe106ce3d2d (7ae6766d-e60d-4d38-9b87-8fe106ce3d2d): created successfully Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30bfbfc6-e717-452b-b9eb-ee12180e836e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Flow 'volume_create_manager' (320bda65-169e-4798-8f53-0808e369fd10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:11 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-200164cf-e192-4140-a468-3e7742c8907f tempest-CreateVolumesFromImageTest-1811908665 None] Created volume successfully. Sep 09 18:32:12 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-732d02e8-559b-4714-97f7-d89cdaa3fad3 1073741824" returned: 0 in 0.410s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-732d02e8-559b-4714-97f7-d89cdaa3fad3 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:12 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-732d02e8-559b-4714-97f7-d89cdaa3fad3 Sep 09 18:32:12 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:12 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-732d02e8-559b-4714-97f7-d89cdaa3fad3" returned: 0 in 0.263s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.112s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-144197406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=015c7c78-d87a-421b-9975-855ff1a7643b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00235c4984e948919d166211e5f779d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:10Z,use_quota=True,user_id='e7dea205007a4239a482a1fa7d0a1ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Creating volume 015c7c78-d87a-421b-9975-855ff1a7643b {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:32:12 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a375f6f-9b49-4c1e-ab36-c04862ba6005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-732d02e8-559b-4714-97f7-d89cdaa3fad3', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33d2fe9-7a3e-4977-8500-8c117e08327c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:12 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b 1073741824 Sep 09 18:32:12 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:12 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Volume volume-732d02e8-559b-4714-97f7-d89cdaa3fad3 (732d02e8-559b-4714-97f7-d89cdaa3fad3): created successfully Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c33d2fe9-7a3e-4977-8500-8c117e08327c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Flow 'volume_create_manager' (34e0ae55-5e3a-4f76-b80a-577c0d6e44b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:12 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-6b268d49-cb6f-41fb-a5c2-69b79e18ddf8 tempest-CreateVolumesFromImageTest-1811908665 None] Created volume successfully. Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Flow 'volume_create_manager' (3405d485-de49-4f2f-a079-807baaa71171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a3df48-7a6b-417f-85a6-51fb2b412a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a3df48-7a6b-417f-85a6-51fb2b412a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-454032291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2561a8ec-0618-4ccd-8514-0a9e2fb9d073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0a90f769854aa2b8b8a38bcd5b296d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:13Z,use_quota=True,user_id='54251b06493f44ea8a1ddeab5f40dd28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f4b0d5-8fdf-47a5-9260-3e7ad3a8bea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f4b0d5-8fdf-47a5-9260-3e7ad3a8bea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96cb07dd-6b18-413b-b6ff-790aadfac382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96cb07dd-6b18-413b-b6ff-790aadfac382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2561a8ec-0618-4ccd-8514-0a9e2fb9d073', 'volume_name': 'volume-2561a8ec-0618-4ccd-8514-0a9e2fb9d073', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93b8cec-ff6b-4e33-9de8-73bda047d519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93b8cec-ff6b-4e33-9de8-73bda047d519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f665c22-bc0d-49b8-95a1-ed7216325e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:12 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Volume 2561a8ec-0618-4ccd-8514-0a9e2fb9d073: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2561a8ec-0618-4ccd-8514-0a9e2fb9d073', 'volume_size': 1} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:12 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b 1073741824" returned: 0 in 0.483s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:12 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b Sep 09 18:32:12 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:13 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b" returned: 0 in 0.255s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.682s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1519447837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efe15f3a-eae1-4e3d-b425-59433b5ae49b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46612cc1d46c470eaf454ae08ef4d982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:10Z,use_quota=True,user_id='38a7bf9e73bf43cea44a8b1bf09e437c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Creating volume efe15f3a-eae1-4e3d-b425-59433b5ae49b {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:32:13 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-efe15f3a-eae1-4e3d-b425-59433b5ae49b 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82fdab2c-a3b4-4834-aac6-8c2a8addc9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-015c7c78-d87a-421b-9975-855ff1a7643b', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:13 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-efe15f3a-eae1-4e3d-b425-59433b5ae49b 1073741824 Sep 09 18:32:13 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1e3f21-0308-49bf-8420-ee13f688d1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:13 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Volume volume-015c7c78-d87a-421b-9975-855ff1a7643b (015c7c78-d87a-421b-9975-855ff1a7643b): created successfully Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf1e3f21-0308-49bf-8420-ee13f688d1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Flow 'volume_create_manager' (c084c5d3-5fca-4e34-b7a0-c9b9b84faa92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:13 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-52aaf911-b1c0-4f8b-9f0d-a98afe8b79bf tempest-VolumeDependencyTests-2108174611 None] Created volume successfully. Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-86299191-813b-47e8-ba6a-aed7758a7ce0 tempest-VolumeDependencyTests-2108174611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:13 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-efe15f3a-eae1-4e3d-b425-59433b5ae49b 1073741824" returned: 0 in 0.484s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-efe15f3a-eae1-4e3d-b425-59433b5ae49b {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:13 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-efe15f3a-eae1-4e3d-b425-59433b5ae49b Sep 09 18:32:13 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:13 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-efe15f3a-eae1-4e3d-b425-59433b5ae49b" returned: 0 in 0.242s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.968s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-453849421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed58502-b97a-492d-bb19-bc107a8281d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46612cc1d46c470eaf454ae08ef4d982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:11Z,use_quota=True,user_id='38a7bf9e73bf43cea44a8b1bf09e437c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Creating volume 3ed58502-b97a-492d-bb19-bc107a8281d0 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:32:13 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ed58502-b97a-492d-bb19-bc107a8281d0 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0055f21b-797e-42d9-9ad1-3a89185dae91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efe15f3a-eae1-4e3d-b425-59433b5ae49b', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:13 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ed58502-b97a-492d-bb19-bc107a8281d0 1073741824 Sep 09 18:32:13 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b487b2-1d4f-46bb-b13f-4de4b82e9af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:13 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Volume volume-efe15f3a-eae1-4e3d-b425-59433b5ae49b (efe15f3a-eae1-4e3d-b425-59433b5ae49b): created successfully Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b487b2-1d4f-46bb-b13f-4de4b82e9af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:13 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Flow 'volume_create_manager' (40e05b56-20e6-4c8f-8fe1-6f584967bdc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:13 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-98b91cee-176b-4fcd-9480-be27a6c2da2c tempest-CreateVolumesFromImageTest-1811908665 None] Created volume successfully. Sep 09 18:32:14 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ed58502-b97a-492d-bb19-bc107a8281d0 1073741824" returned: 0 in 0.386s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ed58502-b97a-492d-bb19-bc107a8281d0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:14 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ed58502-b97a-492d-bb19-bc107a8281d0 Sep 09 18:32:14 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:14 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ed58502-b97a-492d-bb19-bc107a8281d0" returned: 0 in 0.246s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:32:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.278s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1261695853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c8b823-66d4-455f-a66a-6758d0a5360c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46612cc1d46c470eaf454ae08ef4d982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:11Z,use_quota=True,user_id='38a7bf9e73bf43cea44a8b1bf09e437c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:32:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Creating volume d4c8b823-66d4-455f-a66a-6758d0a5360c {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:32:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:32:14 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:32:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4c8b823-66d4-455f-a66a-6758d0a5360c 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:14 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4c8b823-66d4-455f-a66a-6758d0a5360c 1073741824 Sep 09 18:32:14 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:14 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22f6dfa-e381-4718-8011-18edf8c6097f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ed58502-b97a-492d-bb19-bc107a8281d0', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:14 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db0b97a-90f1-42f1-bb36-38f9af517d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:14 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Volume volume-3ed58502-b97a-492d-bb19-bc107a8281d0 (3ed58502-b97a-492d-bb19-bc107a8281d0): created successfully Sep 09 18:32:14 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8db0b97a-90f1-42f1-bb36-38f9af517d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:14 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Flow 'volume_create_manager' (757c2b03-0b75-4d84-9eab-379ea076cfa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:14 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-3def9fdb-8e02-4b3b-a2a9-f49de75087d3 tempest-CreateVolumesFromImageTest-1811908665 None] Created volume successfully. Sep 09 18:32:15 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4c8b823-66d4-455f-a66a-6758d0a5360c 1073741824" returned: 0 in 0.399s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4c8b823-66d4-455f-a66a-6758d0a5360c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:15 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4c8b823-66d4-455f-a66a-6758d0a5360c Sep 09 18:32:15 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:15 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4c8b823-66d4-455f-a66a-6758d0a5360c" returned: 0 in 0.251s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:15 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:32:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-aa8b58e1-87fa-4be6-a7b8-c1f4d1233b01 tempest-CinderUnicodeTest-332552882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.589s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:15 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a603e1e9-ec7c-4d4d-b138-9965a9c147c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4c8b823-66d4-455f-a66a-6758d0a5360c', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:15 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e514fc3-a5a9-44e2-9af8-dc6cab67e3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:15 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-aa8b58e1-87fa-4be6-a7b8-c1f4d1233b01 tempest-CinderUnicodeTest-332552882 None] Creating offline snapshot bc652039-36f3-4f2d-8d7a-27da0fc77fa2 of volume 14444130-82b6-408e-9c33-3a7410cebe6f {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:32:15 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Volume volume-d4c8b823-66d4-455f-a66a-6758d0a5360c (d4c8b823-66d4-455f-a66a-6758d0a5360c): created successfully Sep 09 18:32:15 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e514fc3-a5a9-44e2-9af8-dc6cab67e3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:15 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Flow 'volume_create_manager' (5c246cf8-8ed2-427a-b936-3dee8fd39155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:15 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3d9a6f-8129-4b04-939d-f1144d437545]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa8b58e1-87fa-4be6-a7b8-c1f4d1233b01 tempest-CinderUnicodeTest-332552882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:15 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-de4fe977-6a8f-40ad-98e1-dc556fe18b82 tempest-CreateVolumesFromImageTest-1811908665 None] Created volume successfully. Sep 09 18:32:15 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f Sep 09 18:32:15 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e1ac4ae3-fe50-404e-918d-4da251901feb tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "cinder-d4c8b823-66d4-455f-a66a-6758d0a5360c-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e1ac4ae3-fe50-404e-918d-4da251901feb tempest-CreateVolumesFromImageTest-1811908665 None] Lock "cinder-d4c8b823-66d4-455f-a66a-6758d0a5360c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e1ac4ae3-fe50-404e-918d-4da251901feb tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "cinder-quobyte-d4c8b823-66d4-455f-a66a-6758d0a5360c" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e1ac4ae3-fe50-404e-918d-4da251901feb tempest-CreateVolumesFromImageTest-1811908665 None] Lock "cinder-quobyte-d4c8b823-66d4-455f-a66a-6758d0a5360c" acquired by "delete_volume" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:15 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2d5223-1af9-4f2c-b756-7b846781fd96]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e1ac4ae3-fe50-404e-918d-4da251901feb tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4c8b823-66d4-455f-a66a-6758d0a5360c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:15 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa8b58e1-87fa-4be6-a7b8-c1f4d1233b01 tempest-CinderUnicodeTest-332552882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f" returned: 0 in 0.417s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa8b58e1-87fa-4be6-a7b8-c1f4d1233b01 tempest-CinderUnicodeTest-332552882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.bc652039-36f3-4f2d-8d7a-27da0fc77fa2 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:15 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.bc652039-36f3-4f2d-8d7a-27da0fc77fa2 1G Sep 09 18:32:15 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:15 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4c8b823-66d4-455f-a66a-6758d0a5360c Sep 09 18:32:15 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:16 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e1ac4ae3-fe50-404e-918d-4da251901feb tempest-CreateVolumesFromImageTest-1811908665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4c8b823-66d4-455f-a66a-6758d0a5360c" returned: 0 in 0.380s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e1ac4ae3-fe50-404e-918d-4da251901feb tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4c8b823-66d4-455f-a66a-6758d0a5360c {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:16 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4c8b823-66d4-455f-a66a-6758d0a5360c Sep 09 18:32:16 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:16 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa8b58e1-87fa-4be6-a7b8-c1f4d1233b01 tempest-CinderUnicodeTest-332552882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.bc652039-36f3-4f2d-8d7a-27da0fc77fa2 1G" returned: 0 in 0.426s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa8b58e1-87fa-4be6-a7b8-c1f4d1233b01 tempest-CinderUnicodeTest-332552882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14444130-82b6-408e-9c33-3a7410cebe6f -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.bc652039-36f3-4f2d-8d7a-27da0fc77fa2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:16 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14444130-82b6-408e-9c33-3a7410cebe6f -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.bc652039-36f3-4f2d-8d7a-27da0fc77fa2 Sep 09 18:32:16 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:16 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e1ac4ae3-fe50-404e-918d-4da251901feb tempest-CreateVolumesFromImageTest-1811908665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4c8b823-66d4-455f-a66a-6758d0a5360c" returned: 0 in 0.248s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e1ac4ae3-fe50-404e-918d-4da251901feb tempest-CreateVolumesFromImageTest-1811908665 None] Lock "cinder-quobyte-d4c8b823-66d4-455f-a66a-6758d0a5360c" released by "delete_volume" :: held 0.677s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-e1ac4ae3-fe50-404e-918d-4da251901feb tempest-CreateVolumesFromImageTest-1811908665 None] Created reservations ['45230d09-36e5-42e9-9e47-9c7c10830997', 'b71750f8-3c79-4da7-aa23-f8c6d2f7f397', '9e11c7b0-6ac2-4b11-ba27-98d6ae2d63b1', 'f926e316-0da9-4a32-9e70-339d29594395'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e1ac4ae3-fe50-404e-918d-4da251901feb tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e1ac4ae3-fe50-404e-918d-4da251901feb tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e1ac4ae3-fe50-404e-918d-4da251901feb tempest-CreateVolumesFromImageTest-1811908665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e1ac4ae3-fe50-404e-918d-4da251901feb tempest-CreateVolumesFromImageTest-1811908665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e1ac4ae3-fe50-404e-918d-4da251901feb tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e1ac4ae3-fe50-404e-918d-4da251901feb tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:16 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa8b58e1-87fa-4be6-a7b8-c1f4d1233b01 tempest-CinderUnicodeTest-332552882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14444130-82b6-408e-9c33-3a7410cebe6f -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.bc652039-36f3-4f2d-8d7a-27da0fc77fa2" returned: 0 in 0.319s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:16 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-aa8b58e1-87fa-4be6-a7b8-c1f4d1233b01 tempest-CinderUnicodeTest-332552882 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.bc652039-36f3-4f2d-8d7a-27da0fc77fa2 is being set with open permissions: ugo+rw Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa8b58e1-87fa-4be6-a7b8-c1f4d1233b01 tempest-CinderUnicodeTest-332552882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.bc652039-36f3-4f2d-8d7a-27da0fc77fa2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:16 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:16 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:16 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.bc652039-36f3-4f2d-8d7a-27da0fc77fa2 Sep 09 18:32:16 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:16 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa8b58e1-87fa-4be6-a7b8-c1f4d1233b01 tempest-CinderUnicodeTest-332552882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.bc652039-36f3-4f2d-8d7a-27da0fc77fa2" returned: 0 in 0.249s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:16 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e1ac4ae3-fe50-404e-918d-4da251901feb tempest-CreateVolumesFromImageTest-1811908665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.272s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-e1ac4ae3-fe50-404e-918d-4da251901feb tempest-CreateVolumesFromImageTest-1811908665 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:16 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-e1ac4ae3-fe50-404e-918d-4da251901feb tempest-CreateVolumesFromImageTest-1811908665 None] Deleted volume successfully. Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e1ac4ae3-fe50-404e-918d-4da251901feb tempest-CreateVolumesFromImageTest-1811908665 None] Lock "cinder-d4c8b823-66d4-455f-a66a-6758d0a5360c-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2a1e5c8e-8f08-4681-a0fb-7aecfda67199 tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "cinder-3ed58502-b97a-492d-bb19-bc107a8281d0-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa8b58e1-87fa-4be6-a7b8-c1f4d1233b01 tempest-CinderUnicodeTest-332552882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2a1e5c8e-8f08-4681-a0fb-7aecfda67199 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "cinder-3ed58502-b97a-492d-bb19-bc107a8281d0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:16 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.info Sep 09 18:32:16 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2a1e5c8e-8f08-4681-a0fb-7aecfda67199 tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "cinder-quobyte-3ed58502-b97a-492d-bb19-bc107a8281d0" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2a1e5c8e-8f08-4681-a0fb-7aecfda67199 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "cinder-quobyte-3ed58502-b97a-492d-bb19-bc107a8281d0" acquired by "delete_volume" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04ea679-08f2-49de-b887-58cf2ac35cd1]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a1e5c8e-8f08-4681-a0fb-7aecfda67199 tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ed58502-b97a-492d-bb19-bc107a8281d0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:17 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ed58502-b97a-492d-bb19-bc107a8281d0 Sep 09 18:32:17 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:17 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa8b58e1-87fa-4be6-a7b8-c1f4d1233b01 tempest-CinderUnicodeTest-332552882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.info" returned: 0 in 0.280s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:17 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-aa8b58e1-87fa-4be6-a7b8-c1f4d1233b01 tempest-CinderUnicodeTest-332552882 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.info is being set with open permissions: ugo+rw Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa8b58e1-87fa-4be6-a7b8-c1f4d1233b01 tempest-CinderUnicodeTest-332552882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:17 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.info Sep 09 18:32:17 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:17 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a1e5c8e-8f08-4681-a0fb-7aecfda67199 tempest-CreateVolumesFromImageTest-1811908665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ed58502-b97a-492d-bb19-bc107a8281d0" returned: 0 in 0.372s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a1e5c8e-8f08-4681-a0fb-7aecfda67199 tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ed58502-b97a-492d-bb19-bc107a8281d0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:17 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ed58502-b97a-492d-bb19-bc107a8281d0 Sep 09 18:32:17 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:17 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-aa8b58e1-87fa-4be6-a7b8-c1f4d1233b01 tempest-CinderUnicodeTest-332552882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.info" returned: 0 in 0.250s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-aa8b58e1-87fa-4be6-a7b8-c1f4d1233b01 tempest-CinderUnicodeTest-332552882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.093s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.589s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-454032291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2561a8ec-0618-4ccd-8514-0a9e2fb9d073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0a90f769854aa2b8b8a38bcd5b296d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:13Z,use_quota=True,user_id='54251b06493f44ea8a1ddeab5f40dd28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Creating volume 2561a8ec-0618-4ccd-8514-0a9e2fb9d073 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:32:17 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2561a8ec-0618-4ccd-8514-0a9e2fb9d073 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:17 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2561a8ec-0618-4ccd-8514-0a9e2fb9d073 1073741824 Sep 09 18:32:17 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:17 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-aa8b58e1-87fa-4be6-a7b8-c1f4d1233b01 tempest-CinderUnicodeTest-332552882 None] Create snapshot completed successfully Sep 09 18:32:17 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a1e5c8e-8f08-4681-a0fb-7aecfda67199 tempest-CreateVolumesFromImageTest-1811908665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3ed58502-b97a-492d-bb19-bc107a8281d0" returned: 0 in 0.253s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2a1e5c8e-8f08-4681-a0fb-7aecfda67199 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "cinder-quobyte-3ed58502-b97a-492d-bb19-bc107a8281d0" released by "delete_volume" :: held 0.665s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-2a1e5c8e-8f08-4681-a0fb-7aecfda67199 tempest-CreateVolumesFromImageTest-1811908665 None] Created reservations ['2f119ad3-b4ef-42f1-8246-94a5d82a698d', 'c84f1116-8914-4e68-be77-9def25290803', '947c0568-cd55-4923-aaaa-faee6c5d39f5', 'ea05675b-88c8-4f6d-af16-4cbf7eac8b6f'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2a1e5c8e-8f08-4681-a0fb-7aecfda67199 tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2a1e5c8e-8f08-4681-a0fb-7aecfda67199 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2a1e5c8e-8f08-4681-a0fb-7aecfda67199 tempest-CreateVolumesFromImageTest-1811908665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2a1e5c8e-8f08-4681-a0fb-7aecfda67199 tempest-CreateVolumesFromImageTest-1811908665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2a1e5c8e-8f08-4681-a0fb-7aecfda67199 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a1e5c8e-8f08-4681-a0fb-7aecfda67199 tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:17 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:17 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:17 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2561a8ec-0618-4ccd-8514-0a9e2fb9d073 1073741824" returned: 0 in 0.468s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2561a8ec-0618-4ccd-8514-0a9e2fb9d073 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:17 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2561a8ec-0618-4ccd-8514-0a9e2fb9d073 Sep 09 18:32:17 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:18 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8f6f999f-3d10-40b7-b367-aa021400ec98 tempest-CinderUnicodeTest-332552882 None] Acquiring lock "cinder-bc652039-36f3-4f2d-8d7a-27da0fc77fa2-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a1e5c8e-8f08-4681-a0fb-7aecfda67199 tempest-CreateVolumesFromImageTest-1811908665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.310s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-2a1e5c8e-8f08-4681-a0fb-7aecfda67199 tempest-CreateVolumesFromImageTest-1811908665 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-84cc3047-eedb-4ef1-bf9a-2e9a590cc025 tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "cinder-efe15f3a-eae1-4e3d-b425-59433b5ae49b-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:18 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-2a1e5c8e-8f08-4681-a0fb-7aecfda67199 tempest-CreateVolumesFromImageTest-1811908665 None] Deleted volume successfully. Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8f6f999f-3d10-40b7-b367-aa021400ec98 tempest-CinderUnicodeTest-332552882 None] Lock "cinder-bc652039-36f3-4f2d-8d7a-27da0fc77fa2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8f6f999f-3d10-40b7-b367-aa021400ec98 tempest-CinderUnicodeTest-332552882 None] Acquiring lock "cinder-quobyte-14444130-82b6-408e-9c33-3a7410cebe6f" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-84cc3047-eedb-4ef1-bf9a-2e9a590cc025 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "cinder-efe15f3a-eae1-4e3d-b425-59433b5ae49b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8f6f999f-3d10-40b7-b367-aa021400ec98 tempest-CinderUnicodeTest-332552882 None] Lock "cinder-quobyte-14444130-82b6-408e-9c33-3a7410cebe6f" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8f6f999f-3d10-40b7-b367-aa021400ec98 tempest-CinderUnicodeTest-332552882 None] Acquiring lock "cinder-quobyte-bc652039-36f3-4f2d-8d7a-27da0fc77fa2" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2a1e5c8e-8f08-4681-a0fb-7aecfda67199 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "cinder-3ed58502-b97a-492d-bb19-bc107a8281d0-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8f6f999f-3d10-40b7-b367-aa021400ec98 tempest-CinderUnicodeTest-332552882 None] Lock "cinder-quobyte-bc652039-36f3-4f2d-8d7a-27da0fc77fa2" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-8f6f999f-3d10-40b7-b367-aa021400ec98 tempest-CinderUnicodeTest-332552882 None] Deleting offline snapshot bc652039-36f3-4f2d-8d7a-27da0fc77fa2 of volume 14444130-82b6-408e-9c33-3a7410cebe6f {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-8f6f999f-3d10-40b7-b367-aa021400ec98 tempest-CinderUnicodeTest-332552882 None] snapshot_file for this snap is: volume-14444130-82b6-408e-9c33-3a7410cebe6f.bc652039-36f3-4f2d-8d7a-27da0fc77fa2 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f85797-ce43-4e50-85dd-bfc73f35c8d9]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8f6f999f-3d10-40b7-b367-aa021400ec98 tempest-CinderUnicodeTest-332552882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.bc652039-36f3-4f2d-8d7a-27da0fc77fa2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-84cc3047-eedb-4ef1-bf9a-2e9a590cc025 tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "cinder-quobyte-efe15f3a-eae1-4e3d-b425-59433b5ae49b" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-84cc3047-eedb-4ef1-bf9a-2e9a590cc025 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "cinder-quobyte-efe15f3a-eae1-4e3d-b425-59433b5ae49b" acquired by "delete_volume" :: waited 0.022s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[963d7dce-f0d3-4f0b-a927-b448b567c23b]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-84cc3047-eedb-4ef1-bf9a-2e9a590cc025 tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-efe15f3a-eae1-4e3d-b425-59433b5ae49b {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:18 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2561a8ec-0618-4ccd-8514-0a9e2fb9d073" returned: 0 in 0.326s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-86299191-813b-47e8-ba6a-aed7758a7ce0 tempest-VolumeDependencyTests-2108174611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.688s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f665c22-bc0d-49b8-95a1-ed7216325e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2561a8ec-0618-4ccd-8514-0a9e2fb9d073', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b42c0d-1fa8-4bb6-b91b-00f9df1d71cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-86299191-813b-47e8-ba6a-aed7758a7ce0 tempest-VolumeDependencyTests-2108174611 None] Creating offline snapshot c996e636-96e2-490e-99db-4caa3d838499 of volume 015c7c78-d87a-421b-9975-855ff1a7643b {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:32:18 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.bc652039-36f3-4f2d-8d7a-27da0fc77fa2 Sep 09 18:32:18 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daada40-2157-4e80-8735-01300b03f36e]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-86299191-813b-47e8-ba6a-aed7758a7ce0 tempest-VolumeDependencyTests-2108174611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:18 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Volume volume-2561a8ec-0618-4ccd-8514-0a9e2fb9d073 (2561a8ec-0618-4ccd-8514-0a9e2fb9d073): created successfully Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8b42c0d-1fa8-4bb6-b91b-00f9df1d71cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:18 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-efe15f3a-eae1-4e3d-b425-59433b5ae49b Sep 09 18:32:18 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Flow 'volume_create_manager' (3405d485-de49-4f2f-a079-807baaa71171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:18 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-33a90917-2f56-4fa7-899c-09506a9fac19 tempest-ProjectReaderTests-673545270 None] Created volume successfully. Sep 09 18:32:18 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b Sep 09 18:32:18 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:18 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8f6f999f-3d10-40b7-b367-aa021400ec98 tempest-CinderUnicodeTest-332552882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.bc652039-36f3-4f2d-8d7a-27da0fc77fa2" returned: 0 in 0.384s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-8f6f999f-3d10-40b7-b367-aa021400ec98 tempest-CinderUnicodeTest-332552882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14444130-82b6-408e-9c33-3a7410cebe6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d458bb2-a8a2-4616-b4c5-2b387c41b6c1]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8f6f999f-3d10-40b7-b367-aa021400ec98 tempest-CinderUnicodeTest-332552882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:18 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-84cc3047-eedb-4ef1-bf9a-2e9a590cc025 tempest-CreateVolumesFromImageTest-1811908665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-efe15f3a-eae1-4e3d-b425-59433b5ae49b" returned: 0 in 0.418s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-84cc3047-eedb-4ef1-bf9a-2e9a590cc025 tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-efe15f3a-eae1-4e3d-b425-59433b5ae49b {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:18 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-efe15f3a-eae1-4e3d-b425-59433b5ae49b Sep 09 18:32:18 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:18 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f Sep 09 18:32:18 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:18 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-86299191-813b-47e8-ba6a-aed7758a7ce0 tempest-VolumeDependencyTests-2108174611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b" returned: 0 in 0.431s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-86299191-813b-47e8-ba6a-aed7758a7ce0 tempest-VolumeDependencyTests-2108174611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:18 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499 1G Sep 09 18:32:18 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:18 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-84cc3047-eedb-4ef1-bf9a-2e9a590cc025 tempest-CreateVolumesFromImageTest-1811908665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-efe15f3a-eae1-4e3d-b425-59433b5ae49b" returned: 0 in 0.269s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-84cc3047-eedb-4ef1-bf9a-2e9a590cc025 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "cinder-quobyte-efe15f3a-eae1-4e3d-b425-59433b5ae49b" released by "delete_volume" :: held 0.740s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:19 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8f6f999f-3d10-40b7-b367-aa021400ec98 tempest-CinderUnicodeTest-332552882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f" returned: 0 in 0.410s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8f6f999f-3d10-40b7-b367-aa021400ec98 tempest-CinderUnicodeTest-332552882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.bc652039-36f3-4f2d-8d7a-27da0fc77fa2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-84cc3047-eedb-4ef1-bf9a-2e9a590cc025 tempest-CreateVolumesFromImageTest-1811908665 None] Created reservations ['ae2c3479-0b52-4902-be17-ac488abd6b4e', '746c56f1-5543-4995-b408-c7b18a74f962', '782b74e8-959c-4b1f-a849-8ecb2c6bae80', '45a586cd-5b48-4859-8112-a7944dfdf4dd'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:19 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.bc652039-36f3-4f2d-8d7a-27da0fc77fa2 Sep 09 18:32:19 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-84cc3047-eedb-4ef1-bf9a-2e9a590cc025 tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-84cc3047-eedb-4ef1-bf9a-2e9a590cc025 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-84cc3047-eedb-4ef1-bf9a-2e9a590cc025 tempest-CreateVolumesFromImageTest-1811908665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-84cc3047-eedb-4ef1-bf9a-2e9a590cc025 tempest-CreateVolumesFromImageTest-1811908665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-84cc3047-eedb-4ef1-bf9a-2e9a590cc025 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-84cc3047-eedb-4ef1-bf9a-2e9a590cc025 tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bd7fe472-7d7c-47d8-a000-44488aaa071f tempest-ProjectReaderTests-673545270 None] Acquiring lock "cinder-2561a8ec-0618-4ccd-8514-0a9e2fb9d073-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:19 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:19 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bd7fe472-7d7c-47d8-a000-44488aaa071f tempest-ProjectReaderTests-673545270 None] Lock "cinder-2561a8ec-0618-4ccd-8514-0a9e2fb9d073-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ea8ad5ff-77dc-4da2-bbef-23b07a42fd6c tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "cinder-732d02e8-559b-4714-97f7-d89cdaa3fad3-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bd7fe472-7d7c-47d8-a000-44488aaa071f tempest-ProjectReaderTests-673545270 None] Acquiring lock "cinder-quobyte-2561a8ec-0618-4ccd-8514-0a9e2fb9d073" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ea8ad5ff-77dc-4da2-bbef-23b07a42fd6c tempest-CreateVolumesFromImageTest-1811908665 None] Lock "cinder-732d02e8-559b-4714-97f7-d89cdaa3fad3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bd7fe472-7d7c-47d8-a000-44488aaa071f tempest-ProjectReaderTests-673545270 None] Lock "cinder-quobyte-2561a8ec-0618-4ccd-8514-0a9e2fb9d073" acquired by "delete_volume" :: waited 0.044s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:19 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-86299191-813b-47e8-ba6a-aed7758a7ce0 tempest-VolumeDependencyTests-2108174611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499 1G" returned: 0 in 0.617s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-86299191-813b-47e8-ba6a-aed7758a7ce0 tempest-VolumeDependencyTests-2108174611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-015c7c78-d87a-421b-9975-855ff1a7643b -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f7cae7-42b3-4932-969e-8cc687956c13]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bd7fe472-7d7c-47d8-a000-44488aaa071f tempest-ProjectReaderTests-673545270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2561a8ec-0618-4ccd-8514-0a9e2fb9d073 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:19 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-015c7c78-d87a-421b-9975-855ff1a7643b -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499 Sep 09 18:32:19 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ea8ad5ff-77dc-4da2-bbef-23b07a42fd6c tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "cinder-quobyte-732d02e8-559b-4714-97f7-d89cdaa3fad3" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ea8ad5ff-77dc-4da2-bbef-23b07a42fd6c tempest-CreateVolumesFromImageTest-1811908665 None] Lock "cinder-quobyte-732d02e8-559b-4714-97f7-d89cdaa3fad3" acquired by "delete_volume" :: waited 0.030s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[424053b7-b62c-4e76-ac39-8303c3b12e4b]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ea8ad5ff-77dc-4da2-bbef-23b07a42fd6c tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-732d02e8-559b-4714-97f7-d89cdaa3fad3 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:19 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:19 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2561a8ec-0618-4ccd-8514-0a9e2fb9d073 Sep 09 18:32:19 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8f6f999f-3d10-40b7-b367-aa021400ec98 tempest-CinderUnicodeTest-332552882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.bc652039-36f3-4f2d-8d7a-27da0fc77fa2" returned: 0 in 0.517s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8f6f999f-3d10-40b7-b367-aa021400ec98 tempest-CinderUnicodeTest-332552882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.bc652039-36f3-4f2d-8d7a-27da0fc77fa2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:19 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.bc652039-36f3-4f2d-8d7a-27da0fc77fa2 Sep 09 18:32:19 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:19 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-84cc3047-eedb-4ef1-bf9a-2e9a590cc025 tempest-CreateVolumesFromImageTest-1811908665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.454s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-84cc3047-eedb-4ef1-bf9a-2e9a590cc025 tempest-CreateVolumesFromImageTest-1811908665 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:19 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-84cc3047-eedb-4ef1-bf9a-2e9a590cc025 tempest-CreateVolumesFromImageTest-1811908665 None] Deleted volume successfully. Sep 09 18:32:19 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-732d02e8-559b-4714-97f7-d89cdaa3fad3 Sep 09 18:32:19 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-84cc3047-eedb-4ef1-bf9a-2e9a590cc025 tempest-CreateVolumesFromImageTest-1811908665 None] Lock "cinder-efe15f3a-eae1-4e3d-b425-59433b5ae49b-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:19 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-86299191-813b-47e8-ba6a-aed7758a7ce0 tempest-VolumeDependencyTests-2108174611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-015c7c78-d87a-421b-9975-855ff1a7643b -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499" returned: 0 in 0.396s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:19 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-86299191-813b-47e8-ba6a-aed7758a7ce0 tempest-VolumeDependencyTests-2108174611 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499 is being set with open permissions: ugo+rw Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-86299191-813b-47e8-ba6a-aed7758a7ce0 tempest-VolumeDependencyTests-2108174611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:19 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499 Sep 09 18:32:19 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:19 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bd7fe472-7d7c-47d8-a000-44488aaa071f tempest-ProjectReaderTests-673545270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2561a8ec-0618-4ccd-8514-0a9e2fb9d073" returned: 0 in 0.455s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bd7fe472-7d7c-47d8-a000-44488aaa071f tempest-ProjectReaderTests-673545270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2561a8ec-0618-4ccd-8514-0a9e2fb9d073 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:19 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2561a8ec-0618-4ccd-8514-0a9e2fb9d073 Sep 09 18:32:19 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:19 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8f6f999f-3d10-40b7-b367-aa021400ec98 tempest-CinderUnicodeTest-332552882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f.bc652039-36f3-4f2d-8d7a-27da0fc77fa2" returned: 0 in 0.354s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8f6f999f-3d10-40b7-b367-aa021400ec98 tempest-CinderUnicodeTest-332552882 None] Lock "cinder-quobyte-bc652039-36f3-4f2d-8d7a-27da0fc77fa2" released by "_delete_snapshot" :: held 1.798s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8f6f999f-3d10-40b7-b367-aa021400ec98 tempest-CinderUnicodeTest-332552882 None] Lock "cinder-quobyte-14444130-82b6-408e-9c33-3a7410cebe6f" released by "delete_snapshot" :: held 1.839s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:19 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ea8ad5ff-77dc-4da2-bbef-23b07a42fd6c tempest-CreateVolumesFromImageTest-1811908665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-732d02e8-559b-4714-97f7-d89cdaa3fad3" returned: 0 in 0.498s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ea8ad5ff-77dc-4da2-bbef-23b07a42fd6c tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-732d02e8-559b-4714-97f7-d89cdaa3fad3 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-8f6f999f-3d10-40b7-b367-aa021400ec98 tempest-CinderUnicodeTest-332552882 None] Created reservations ['1c1aaa30-c120-4588-9f72-03c1dfbda1fb', '9785cb90-24ce-47c5-a830-97976df831e6', '0603d741-36c7-4a58-87bc-4a916854a1a9', '5205bbf0-cb70-407e-883c-6ff0b19119d7'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:20 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-732d02e8-559b-4714-97f7-d89cdaa3fad3 Sep 09 18:32:20 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:20 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-86299191-813b-47e8-ba6a-aed7758a7ce0 tempest-VolumeDependencyTests-2108174611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499" returned: 0 in 0.322s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:20 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-8f6f999f-3d10-40b7-b367-aa021400ec98 tempest-CinderUnicodeTest-332552882 None] Delete snapshot completed successfully. Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8f6f999f-3d10-40b7-b367-aa021400ec98 tempest-CinderUnicodeTest-332552882 None] Lock "cinder-bc652039-36f3-4f2d-8d7a-27da0fc77fa2-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-86299191-813b-47e8-ba6a-aed7758a7ce0 tempest-VolumeDependencyTests-2108174611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:20 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bd7fe472-7d7c-47d8-a000-44488aaa071f tempest-ProjectReaderTests-673545270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2561a8ec-0618-4ccd-8514-0a9e2fb9d073" returned: 0 in 0.305s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:20 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.info Sep 09 18:32:20 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bd7fe472-7d7c-47d8-a000-44488aaa071f tempest-ProjectReaderTests-673545270 None] Lock "cinder-quobyte-2561a8ec-0618-4ccd-8514-0a9e2fb9d073" released by "delete_volume" :: held 0.843s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5539229b-f372-4ca5-9613-400fa73b05ef tempest-CinderUnicodeTest-332552882 None] Acquiring lock "cinder-14444130-82b6-408e-9c33-3a7410cebe6f-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-bd7fe472-7d7c-47d8-a000-44488aaa071f tempest-ProjectReaderTests-673545270 None] Created reservations ['e1fc41d1-24de-4d63-9ef4-e02f7b07c3f8', '845ad199-bb0b-4119-a4ac-c3fbe8a8e913', '6dee5efc-5485-4e5f-ae81-0b2de50b0f7b', '2cab4fd2-1f2d-4ecb-80dc-6749cdf3353f'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5539229b-f372-4ca5-9613-400fa73b05ef tempest-CinderUnicodeTest-332552882 None] Lock "cinder-14444130-82b6-408e-9c33-3a7410cebe6f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bd7fe472-7d7c-47d8-a000-44488aaa071f tempest-ProjectReaderTests-673545270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bd7fe472-7d7c-47d8-a000-44488aaa071f tempest-ProjectReaderTests-673545270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-bd7fe472-7d7c-47d8-a000-44488aaa071f tempest-ProjectReaderTests-673545270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-bd7fe472-7d7c-47d8-a000-44488aaa071f tempest-ProjectReaderTests-673545270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bd7fe472-7d7c-47d8-a000-44488aaa071f tempest-ProjectReaderTests-673545270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bd7fe472-7d7c-47d8-a000-44488aaa071f tempest-ProjectReaderTests-673545270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5539229b-f372-4ca5-9613-400fa73b05ef tempest-CinderUnicodeTest-332552882 None] Acquiring lock "cinder-quobyte-14444130-82b6-408e-9c33-3a7410cebe6f" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:20 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ea8ad5ff-77dc-4da2-bbef-23b07a42fd6c tempest-CreateVolumesFromImageTest-1811908665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-732d02e8-559b-4714-97f7-d89cdaa3fad3" returned: 0 in 0.386s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ea8ad5ff-77dc-4da2-bbef-23b07a42fd6c tempest-CreateVolumesFromImageTest-1811908665 None] Lock "cinder-quobyte-732d02e8-559b-4714-97f7-d89cdaa3fad3" released by "delete_volume" :: held 0.946s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:20 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5539229b-f372-4ca5-9613-400fa73b05ef tempest-CinderUnicodeTest-332552882 None] Lock "cinder-quobyte-14444130-82b6-408e-9c33-3a7410cebe6f" acquired by "delete_volume" :: waited 0.040s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:20 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf12bf67-46ca-4b96-a142-a43057e87b0f]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5539229b-f372-4ca5-9613-400fa73b05ef tempest-CinderUnicodeTest-332552882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:20 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-86299191-813b-47e8-ba6a-aed7758a7ce0 tempest-VolumeDependencyTests-2108174611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.info" returned: 0 in 0.380s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:20 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-86299191-813b-47e8-ba6a-aed7758a7ce0 tempest-VolumeDependencyTests-2108174611 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.info is being set with open permissions: ugo+rw Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-86299191-813b-47e8-ba6a-aed7758a7ce0 tempest-VolumeDependencyTests-2108174611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-ea8ad5ff-77dc-4da2-bbef-23b07a42fd6c tempest-CreateVolumesFromImageTest-1811908665 None] Created reservations ['a0fa3181-3297-48b0-b582-26722a31c310', '0d6ba620-eab6-4157-a0b4-b2f17397cf30', '2f0ef5e2-353c-428e-9664-f43f8d2c6771', 'dee8a643-8816-4b46-9106-91eb2f728fa5'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:20 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.info Sep 09 18:32:20 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:20 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f Sep 09 18:32:20 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:20 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bd7fe472-7d7c-47d8-a000-44488aaa071f tempest-ProjectReaderTests-673545270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.321s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-bd7fe472-7d7c-47d8-a000-44488aaa071f tempest-ProjectReaderTests-673545270 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ea8ad5ff-77dc-4da2-bbef-23b07a42fd6c tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ea8ad5ff-77dc-4da2-bbef-23b07a42fd6c tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ea8ad5ff-77dc-4da2-bbef-23b07a42fd6c tempest-CreateVolumesFromImageTest-1811908665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ea8ad5ff-77dc-4da2-bbef-23b07a42fd6c tempest-CreateVolumesFromImageTest-1811908665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ea8ad5ff-77dc-4da2-bbef-23b07a42fd6c tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ea8ad5ff-77dc-4da2-bbef-23b07a42fd6c tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:20 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-bd7fe472-7d7c-47d8-a000-44488aaa071f tempest-ProjectReaderTests-673545270 None] Deleted volume successfully. Sep 09 18:32:20 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:20 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-bd7fe472-7d7c-47d8-a000-44488aaa071f tempest-ProjectReaderTests-673545270 None] Lock "cinder-2561a8ec-0618-4ccd-8514-0a9e2fb9d073-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:20 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-86299191-813b-47e8-ba6a-aed7758a7ce0 tempest-VolumeDependencyTests-2108174611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.info" returned: 0 in 0.396s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-86299191-813b-47e8-ba6a-aed7758a7ce0 tempest-VolumeDependencyTests-2108174611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.685s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:20 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-86299191-813b-47e8-ba6a-aed7758a7ce0 tempest-VolumeDependencyTests-2108174611 None] Create snapshot completed successfully Sep 09 18:32:20 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5539229b-f372-4ca5-9613-400fa73b05ef tempest-CinderUnicodeTest-332552882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f" returned: 0 in 0.525s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5539229b-f372-4ca5-9613-400fa73b05ef tempest-CinderUnicodeTest-332552882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:21 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f Sep 09 18:32:21 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:21 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ea8ad5ff-77dc-4da2-bbef-23b07a42fd6c tempest-CreateVolumesFromImageTest-1811908665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.346s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-ea8ad5ff-77dc-4da2-bbef-23b07a42fd6c tempest-CreateVolumesFromImageTest-1811908665 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:21 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ea8ad5ff-77dc-4da2-bbef-23b07a42fd6c tempest-CreateVolumesFromImageTest-1811908665 None] Deleted volume successfully. Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ea8ad5ff-77dc-4da2-bbef-23b07a42fd6c tempest-CreateVolumesFromImageTest-1811908665 None] Lock "cinder-732d02e8-559b-4714-97f7-d89cdaa3fad3-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Flow 'volume_create_manager' (e50693f9-9f47-423f-a5af-96628a098bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f166dee8-c8f0-491a-a002-11614a6a5f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f166dee8-c8f0-491a-a002-11614a6a5f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1577329365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24903ec-5697-4ae5-9a1f-c55981bdf1df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0a90f769854aa2b8b8a38bcd5b296d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:21Z,use_quota=True,user_id='54251b06493f44ea8a1ddeab5f40dd28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7fc7011-eb58-4067-a424-e2ea4a8d339b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7fc7011-eb58-4067-a424-e2ea4a8d339b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37c885d-4933-48e5-b457-7ee5e4d00088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37c885d-4933-48e5-b457-7ee5e4d00088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b24903ec-5697-4ae5-9a1f-c55981bdf1df', 'volume_name': 'volume-b24903ec-5697-4ae5-9a1f-c55981bdf1df', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e4dd16-5258-4a89-a785-95976206e822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e4dd16-5258-4a89-a785-95976206e822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2fbe77d-6538-4884-ac0f-efdb463fef10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:21 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Volume b24903ec-5697-4ae5-9a1f-c55981bdf1df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b24903ec-5697-4ae5-9a1f-c55981bdf1df', 'volume_size': 1} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1577329365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b24903ec-5697-4ae5-9a1f-c55981bdf1df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0a90f769854aa2b8b8a38bcd5b296d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:21Z,use_quota=True,user_id='54251b06493f44ea8a1ddeab5f40dd28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Creating volume b24903ec-5697-4ae5-9a1f-c55981bdf1df {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:32:21 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b24903ec-5697-4ae5-9a1f-c55981bdf1df 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:21 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b24903ec-5697-4ae5-9a1f-c55981bdf1df 1073741824 Sep 09 18:32:21 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:21 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5539229b-f372-4ca5-9613-400fa73b05ef tempest-CinderUnicodeTest-332552882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-14444130-82b6-408e-9c33-3a7410cebe6f" returned: 0 in 0.258s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5539229b-f372-4ca5-9613-400fa73b05ef tempest-CinderUnicodeTest-332552882 None] Lock "cinder-quobyte-14444130-82b6-408e-9c33-3a7410cebe6f" released by "delete_volume" :: held 0.856s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-5539229b-f372-4ca5-9613-400fa73b05ef tempest-CinderUnicodeTest-332552882 None] Created reservations ['df740134-c7ff-41da-9407-aa8b1f0eaec2', '5be2f40e-bc43-499e-85b2-bf5f2919b21d', '691dcf9c-5a95-4add-bcd4-814922105e21', '37b55f22-c6b4-4257-b5dd-a39b16653c8e'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5539229b-f372-4ca5-9613-400fa73b05ef tempest-CinderUnicodeTest-332552882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5539229b-f372-4ca5-9613-400fa73b05ef tempest-CinderUnicodeTest-332552882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5539229b-f372-4ca5-9613-400fa73b05ef tempest-CinderUnicodeTest-332552882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5539229b-f372-4ca5-9613-400fa73b05ef tempest-CinderUnicodeTest-332552882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5539229b-f372-4ca5-9613-400fa73b05ef tempest-CinderUnicodeTest-332552882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5539229b-f372-4ca5-9613-400fa73b05ef tempest-CinderUnicodeTest-332552882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:21 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:21 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b562d6ec-6d2d-421d-84ea-d409921ee859 tempest-CinderUnicodeTest-332552882 None] Acquiring lock "cinder-70e000e7-cf51-436a-937a-1f9c98835b2d-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b562d6ec-6d2d-421d-84ea-d409921ee859 tempest-CinderUnicodeTest-332552882 None] Lock "cinder-70e000e7-cf51-436a-937a-1f9c98835b2d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b562d6ec-6d2d-421d-84ea-d409921ee859 tempest-CinderUnicodeTest-332552882 None] Acquiring lock "cinder-quobyte-70e000e7-cf51-436a-937a-1f9c98835b2d" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b562d6ec-6d2d-421d-84ea-d409921ee859 tempest-CinderUnicodeTest-332552882 None] Lock "cinder-quobyte-70e000e7-cf51-436a-937a-1f9c98835b2d" acquired by "delete_volume" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0d18ed-839d-4e33-8291-c67ec1abe8c5]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b562d6ec-6d2d-421d-84ea-d409921ee859 tempest-CinderUnicodeTest-332552882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70e000e7-cf51-436a-937a-1f9c98835b2d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3605b793-5580-4113-ba21-ba0c5a6e577c tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "cinder-7ae6766d-e60d-4d38-9b87-8fe106ce3d2d-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3605b793-5580-4113-ba21-ba0c5a6e577c tempest-CreateVolumesFromImageTest-1811908665 None] Lock "cinder-7ae6766d-e60d-4d38-9b87-8fe106ce3d2d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3605b793-5580-4113-ba21-ba0c5a6e577c tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "cinder-quobyte-7ae6766d-e60d-4d38-9b87-8fe106ce3d2d" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:21 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5539229b-f372-4ca5-9613-400fa73b05ef tempest-CinderUnicodeTest-332552882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.324s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-5539229b-f372-4ca5-9613-400fa73b05ef tempest-CinderUnicodeTest-332552882 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3605b793-5580-4113-ba21-ba0c5a6e577c tempest-CreateVolumesFromImageTest-1811908665 None] Lock "cinder-quobyte-7ae6766d-e60d-4d38-9b87-8fe106ce3d2d" acquired by "delete_volume" :: waited 0.020s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:21 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-5539229b-f372-4ca5-9613-400fa73b05ef tempest-CinderUnicodeTest-332552882 None] Deleted volume successfully. Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[39286849-8252-4c11-b616-6dd44d87ae5d]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3605b793-5580-4113-ba21-ba0c5a6e577c tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ae6766d-e60d-4d38-9b87-8fe106ce3d2d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5539229b-f372-4ca5-9613-400fa73b05ef tempest-CinderUnicodeTest-332552882 None] Lock "cinder-14444130-82b6-408e-9c33-3a7410cebe6f-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:21 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b24903ec-5697-4ae5-9a1f-c55981bdf1df 1073741824" returned: 0 in 0.587s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:21 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70e000e7-cf51-436a-937a-1f9c98835b2d Sep 09 18:32:21 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b24903ec-5697-4ae5-9a1f-c55981bdf1df {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:21 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b24903ec-5697-4ae5-9a1f-c55981bdf1df Sep 09 18:32:21 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:21 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ae6766d-e60d-4d38-9b87-8fe106ce3d2d Sep 09 18:32:21 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:22 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b562d6ec-6d2d-421d-84ea-d409921ee859 tempest-CinderUnicodeTest-332552882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70e000e7-cf51-436a-937a-1f9c98835b2d" returned: 0 in 0.497s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b562d6ec-6d2d-421d-84ea-d409921ee859 tempest-CinderUnicodeTest-332552882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70e000e7-cf51-436a-937a-1f9c98835b2d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:22 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b24903ec-5697-4ae5-9a1f-c55981bdf1df" returned: 0 in 0.318s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:22 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70e000e7-cf51-436a-937a-1f9c98835b2d Sep 09 18:32:22 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2fbe77d-6538-4884-ac0f-efdb463fef10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b24903ec-5697-4ae5-9a1f-c55981bdf1df', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b8a09d-af00-4263-9b25-8b3dee6062a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:22 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Volume volume-b24903ec-5697-4ae5-9a1f-c55981bdf1df (b24903ec-5697-4ae5-9a1f-c55981bdf1df): created successfully Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b8a09d-af00-4263-9b25-8b3dee6062a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:22 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Flow 'volume_create_manager' (e50693f9-9f47-423f-a5af-96628a098bd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3605b793-5580-4113-ba21-ba0c5a6e577c tempest-CreateVolumesFromImageTest-1811908665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ae6766d-e60d-4d38-9b87-8fe106ce3d2d" returned: 0 in 0.454s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3605b793-5580-4113-ba21-ba0c5a6e577c tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ae6766d-e60d-4d38-9b87-8fe106ce3d2d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:22 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-6ded7e5c-5a7a-4d87-a788-b53447695f1a tempest-ProjectReaderTests-673545270 None] Created volume successfully. Sep 09 18:32:22 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ae6766d-e60d-4d38-9b87-8fe106ce3d2d Sep 09 18:32:22 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:22 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b562d6ec-6d2d-421d-84ea-d409921ee859 tempest-CinderUnicodeTest-332552882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70e000e7-cf51-436a-937a-1f9c98835b2d" returned: 0 in 0.296s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b562d6ec-6d2d-421d-84ea-d409921ee859 tempest-CinderUnicodeTest-332552882 None] Lock "cinder-quobyte-70e000e7-cf51-436a-937a-1f9c98835b2d" released by "delete_volume" :: held 0.845s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:22 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3605b793-5580-4113-ba21-ba0c5a6e577c tempest-CreateVolumesFromImageTest-1811908665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-7ae6766d-e60d-4d38-9b87-8fe106ce3d2d" returned: 0 in 0.277s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-b562d6ec-6d2d-421d-84ea-d409921ee859 tempest-CinderUnicodeTest-332552882 None] Created reservations ['b6c4be0f-bf25-4f73-a266-d9ddd0b07859', 'd8326806-8fd1-4146-8235-845d1e96eae4', '98f3d1f5-6152-4caf-9812-d5ca2cc23385', 'd6e2304c-5cb3-4e5c-b3e7-44039a57285a'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3605b793-5580-4113-ba21-ba0c5a6e577c tempest-CreateVolumesFromImageTest-1811908665 None] Lock "cinder-quobyte-7ae6766d-e60d-4d38-9b87-8fe106ce3d2d" released by "delete_volume" :: held 0.778s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b562d6ec-6d2d-421d-84ea-d409921ee859 tempest-CinderUnicodeTest-332552882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b562d6ec-6d2d-421d-84ea-d409921ee859 tempest-CinderUnicodeTest-332552882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b562d6ec-6d2d-421d-84ea-d409921ee859 tempest-CinderUnicodeTest-332552882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b562d6ec-6d2d-421d-84ea-d409921ee859 tempest-CinderUnicodeTest-332552882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b562d6ec-6d2d-421d-84ea-d409921ee859 tempest-CinderUnicodeTest-332552882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b562d6ec-6d2d-421d-84ea-d409921ee859 tempest-CinderUnicodeTest-332552882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-3605b793-5580-4113-ba21-ba0c5a6e577c tempest-CreateVolumesFromImageTest-1811908665 None] Created reservations ['fcd4d606-4cb4-4021-b0a8-8bc9c418fe27', '200cd332-b74e-40bc-8f60-a7d837d04a45', 'd86ee0e5-cb5f-4fd5-a0ad-b7d3648b4c37', '57104815-d423-4907-a3bf-356a03f1ca69'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:22 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:22 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Flow 'volume_create_manager' (f2461c54-e5fc-4824-81ec-e2360413a607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d9cc130-a147-4897-ac7b-40b45f9ee0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d9cc130-a147-4897-ac7b-40b45f9ee0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-581223266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=319b3af3-c7ce-4874-8bf7-328dfc3817d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00235c4984e948919d166211e5f779d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c996e636-96e2-490e-99db-4caa3d838499,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:23Z,use_quota=True,user_id='e7dea205007a4239a482a1fa7d0a1ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfac70bc-b25a-4bd1-883f-c1ae1f22e44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfac70bc-b25a-4bd1-883f-c1ae1f22e44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c164816-9054-4fbe-90b9-accb63b83eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c164816-9054-4fbe-90b9-accb63b83eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '319b3af3-c7ce-4874-8bf7-328dfc3817d6', 'volume_name': 'volume-319b3af3-c7ce-4874-8bf7-328dfc3817d6', 'volume_size': 1, 'snapshot_id': 'c996e636-96e2-490e-99db-4caa3d838499'}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3270f57-d48d-4b94-a3c4-4c64d61fae0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3270f57-d48d-4b94-a3c4-4c64d61fae0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c2ec801-0ab7-429b-ace1-3cd10c135e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:22 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Volume 319b3af3-c7ce-4874-8bf7-328dfc3817d6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-319b3af3-c7ce-4874-8bf7-328dfc3817d6', 'volume_size': 1, 'snapshot_id': 'c996e636-96e2-490e-99db-4caa3d838499'} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Acquiring lock "cinder-quobyte-c996e636-96e2-490e-99db-4caa3d838499-319b3af3-c7ce-4874-8bf7-328dfc3817d6" by "_create_volume_from_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Lock "cinder-quobyte-c996e636-96e2-490e-99db-4caa3d838499-319b3af3-c7ce-4874-8bf7-328dfc3817d6" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Creating volume 319b3af3-c7ce-4874-8bf7-328dfc3817d6 from snapshot c996e636-96e2-490e-99db-4caa3d838499 {{(pid=87639) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Acquiring lock "cinder-quobyte-319b3af3-c7ce-4874-8bf7-328dfc3817d6" by "_copy_volume_from_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3605b793-5580-4113-ba21-ba0c5a6e577c tempest-CreateVolumesFromImageTest-1811908665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3605b793-5580-4113-ba21-ba0c5a6e577c tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3605b793-5580-4113-ba21-ba0c5a6e577c tempest-CreateVolumesFromImageTest-1811908665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3605b793-5580-4113-ba21-ba0c5a6e577c tempest-CreateVolumesFromImageTest-1811908665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3605b793-5580-4113-ba21-ba0c5a6e577c tempest-CreateVolumesFromImageTest-1811908665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3605b793-5580-4113-ba21-ba0c5a6e577c tempest-CreateVolumesFromImageTest-1811908665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Lock "cinder-quobyte-319b3af3-c7ce-4874-8bf7-328dfc3817d6" acquired by "_copy_volume_from_snapshot" :: waited 0.055s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] snapshot: c996e636-96e2-490e-99db-4caa3d838499, volume: 319b3af3-c7ce-4874-8bf7-328dfc3817d6, {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 18:32:22 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:22 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8fc781-1f07-4df0-81aa-2c9340e5fc6c]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:22 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b562d6ec-6d2d-421d-84ea-d409921ee859 tempest-CinderUnicodeTest-332552882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.365s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:22 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-b562d6ec-6d2d-421d-84ea-d409921ee859 tempest-CinderUnicodeTest-332552882 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:22 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-b562d6ec-6d2d-421d-84ea-d409921ee859 tempest-CinderUnicodeTest-332552882 None] Deleted volume successfully. Sep 09 18:32:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b562d6ec-6d2d-421d-84ea-d409921ee859 tempest-CinderUnicodeTest-332552882 None] Lock "cinder-70e000e7-cf51-436a-937a-1f9c98835b2d-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:23 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499 Sep 09 18:32:23 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:23 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3605b793-5580-4113-ba21-ba0c5a6e577c tempest-CreateVolumesFromImageTest-1811908665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.335s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:23 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-3605b793-5580-4113-ba21-ba0c5a6e577c tempest-CreateVolumesFromImageTest-1811908665 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:23 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-3605b793-5580-4113-ba21-ba0c5a6e577c tempest-CreateVolumesFromImageTest-1811908665 None] Deleted volume successfully. Sep 09 18:32:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-3605b793-5580-4113-ba21-ba0c5a6e577c tempest-CreateVolumesFromImageTest-1811908665 None] Lock "cinder-7ae6766d-e60d-4d38-9b87-8fe106ce3d2d-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ce27dce0-983a-4c3b-a169-41d346eb4cfc tempest-ProjectReaderTests-673545270 None] Acquiring lock "cinder-b24903ec-5697-4ae5-9a1f-c55981bdf1df-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ce27dce0-983a-4c3b-a169-41d346eb4cfc tempest-ProjectReaderTests-673545270 None] Lock "cinder-b24903ec-5697-4ae5-9a1f-c55981bdf1df-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ce27dce0-983a-4c3b-a169-41d346eb4cfc tempest-ProjectReaderTests-673545270 None] Acquiring lock "cinder-quobyte-b24903ec-5697-4ae5-9a1f-c55981bdf1df" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ce27dce0-983a-4c3b-a169-41d346eb4cfc tempest-ProjectReaderTests-673545270 None] Lock "cinder-quobyte-b24903ec-5697-4ae5-9a1f-c55981bdf1df" acquired by "delete_volume" :: waited 0.040s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:23 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:23 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a4cb80-7993-4c86-b1d6-7141da813d93]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ce27dce0-983a-4c3b-a169-41d346eb4cfc tempest-ProjectReaderTests-673545270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b24903ec-5697-4ae5-9a1f-c55981bdf1df {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499" returned: 0 in 0.527s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-015c7c78-d87a-421b-9975-855ff1a7643b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:32:23 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1cfd82-fdf7-470d-b6ad-d77259221296]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:23 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b24903ec-5697-4ae5-9a1f-c55981bdf1df Sep 09 18:32:23 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:23 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b Sep 09 18:32:23 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:23 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:23 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b" returned: 0 in 0.482s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 18:32:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Creating direct copy from snapshot {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 18:32:23 devstack cinder-volume[87639]: DEBUG cinder.utils [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Path /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-319b3af3-c7ce-4874-8bf7-328dfc3817d6 not found in is_blk_device check {{(pid=87639) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 18:32:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-319b3af3-c7ce-4874-8bf7-328dfc3817d6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ce27dce0-983a-4c3b-a169-41d346eb4cfc tempest-ProjectReaderTests-673545270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b24903ec-5697-4ae5-9a1f-c55981bdf1df" returned: 0 in 0.543s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ce27dce0-983a-4c3b-a169-41d346eb4cfc tempest-ProjectReaderTests-673545270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b24903ec-5697-4ae5-9a1f-c55981bdf1df {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:24 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-319b3af3-c7ce-4874-8bf7-328dfc3817d6 Sep 09 18:32:24 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:24 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b24903ec-5697-4ae5-9a1f-c55981bdf1df Sep 09 18:32:24 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:24 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ce27dce0-983a-4c3b-a169-41d346eb4cfc tempest-ProjectReaderTests-673545270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b24903ec-5697-4ae5-9a1f-c55981bdf1df" returned: 0 in 0.307s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:24 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ce27dce0-983a-4c3b-a169-41d346eb4cfc tempest-ProjectReaderTests-673545270 None] Lock "cinder-quobyte-b24903ec-5697-4ae5-9a1f-c55981bdf1df" released by "delete_volume" :: held 0.913s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:24 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-ce27dce0-983a-4c3b-a169-41d346eb4cfc tempest-ProjectReaderTests-673545270 None] Created reservations ['9e840de0-8907-4bc9-ba91-972b55c1a4a8', 'ec5fb785-f2aa-40b6-86ea-839b17b4cb89', '945c42e4-8262-4791-ae24-69257bfd69e7', '2711c39b-7d9b-4672-8333-02d6d334bc65'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ce27dce0-983a-4c3b-a169-41d346eb4cfc tempest-ProjectReaderTests-673545270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ce27dce0-983a-4c3b-a169-41d346eb4cfc tempest-ProjectReaderTests-673545270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ce27dce0-983a-4c3b-a169-41d346eb4cfc tempest-ProjectReaderTests-673545270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ce27dce0-983a-4c3b-a169-41d346eb4cfc tempest-ProjectReaderTests-673545270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ce27dce0-983a-4c3b-a169-41d346eb4cfc tempest-ProjectReaderTests-673545270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ce27dce0-983a-4c3b-a169-41d346eb4cfc tempest-ProjectReaderTests-673545270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:24 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:24 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:25 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ce27dce0-983a-4c3b-a169-41d346eb4cfc tempest-ProjectReaderTests-673545270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.682s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:25 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-ce27dce0-983a-4c3b-a169-41d346eb4cfc tempest-ProjectReaderTests-673545270 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:25 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ce27dce0-983a-4c3b-a169-41d346eb4cfc tempest-ProjectReaderTests-673545270 None] Deleted volume successfully. Sep 09 18:32:25 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ce27dce0-983a-4c3b-a169-41d346eb4cfc tempest-ProjectReaderTests-673545270 None] Lock "cinder-b24903ec-5697-4ae5-9a1f-c55981bdf1df-delete_volume" released by "delete_volume" :: held 2.013s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:26 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:32:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Flow 'volume_create_manager' (4129ec77-9b12-4d58-87a9-1e23e616f9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e1e55b-66f6-4a70-945e-2d87ee1d21bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e1e55b-66f6-4a70-945e-2d87ee1d21bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2118688345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76543a14-52c3-4d3e-b9fb-e9a9ae0f0880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0a90f769854aa2b8b8a38bcd5b296d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:26Z,use_quota=True,user_id='54251b06493f44ea8a1ddeab5f40dd28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b463a9df-4b13-4993-9922-3b1077a54490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b463a9df-4b13-4993-9922-3b1077a54490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a205053e-0e55-46be-8f68-304df9bc6204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a205053e-0e55-46be-8f68-304df9bc6204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76543a14-52c3-4d3e-b9fb-e9a9ae0f0880', 'volume_name': 'volume-76543a14-52c3-4d3e-b9fb-e9a9ae0f0880', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3122ce1b-2bf3-4cb4-a643-0f8883330c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3122ce1b-2bf3-4cb4-a643-0f8883330c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b48c863-ac80-443a-a885-3fec108a4187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:26 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Volume 76543a14-52c3-4d3e-b9fb-e9a9ae0f0880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76543a14-52c3-4d3e-b9fb-e9a9ae0f0880', 'volume_size': 1} Sep 09 18:32:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Flow 'volume_create_manager' (f5e845f9-02f3-4e79-ba7a-cd14a6f0abf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c369bb7-145c-47f2-a2db-5793a69cfef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:30 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-319b3af3-c7ce-4874-8bf7-328dfc3817d6" returned: 0 in 6.096s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Image conversion details: src /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b, size 1024.00 MB, duration 6.10 sec, destination /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-319b3af3-c7ce-4874-8bf7-328dfc3817d6 {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:32:30 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Converted 1024.00 MB image at 167.95 MB/s Sep 09 18:32:30 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-319b3af3-c7ce-4874-8bf7-328dfc3817d6 is being set with open permissions: ugo+rw Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-319b3af3-c7ce-4874-8bf7-328dfc3817d6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c369bb7-145c-47f2-a2db-5793a69cfef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647563190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0d25227-b1b2-41d1-9ad2-2241fc19f702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ca6b2e960a421fa01cc6cd47a41428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:30Z,use_quota=True,user_id='7af08b76357f43e587baf7b65d065371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:30 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-319b3af3-c7ce-4874-8bf7-328dfc3817d6 Sep 09 18:32:30 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25705c1-837b-4357-b689-e7702aad0e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25705c1-837b-4357-b689-e7702aad0e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68eb956-c43e-414f-a7ef-3dacde1635fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d68eb956-c43e-414f-a7ef-3dacde1635fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0d25227-b1b2-41d1-9ad2-2241fc19f702', 'volume_name': 'volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49594860-07a5-4135-a156-02efad005c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49594860-07a5-4135-a156-02efad005c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26841b17-a10f-4a4d-9830-2f856e2ca6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:30 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Volume b0d25227-b1b2-41d1-9ad2-2241fc19f702: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702', 'volume_size': 1} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:30 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-319b3af3-c7ce-4874-8bf7-328dfc3817d6" returned: 0 in 0.261s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Lock "cinder-quobyte-319b3af3-c7ce-4874-8bf7-328dfc3817d6" released by "_copy_volume_from_snapshot" :: held 7.506s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Lock "cinder-quobyte-c996e636-96e2-490e-99db-4caa3d838499-319b3af3-c7ce-4874-8bf7-328dfc3817d6" released by "_create_volume_from_snapshot" :: held 7.616s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.645s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.296s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2118688345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76543a14-52c3-4d3e-b9fb-e9a9ae0f0880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0a90f769854aa2b8b8a38bcd5b296d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:26Z,use_quota=True,user_id='54251b06493f44ea8a1ddeab5f40dd28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Creating volume 76543a14-52c3-4d3e-b9fb-e9a9ae0f0880 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:32:30 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-76543a14-52c3-4d3e-b9fb-e9a9ae0f0880 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:30 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-76543a14-52c3-4d3e-b9fb-e9a9ae0f0880 1073741824 Sep 09 18:32:30 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c2ec801-0ab7-429b-ace1-3cd10c135e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-319b3af3-c7ce-4874-8bf7-328dfc3817d6', 'volume_size': 1, 'snapshot_id': 'c996e636-96e2-490e-99db-4caa3d838499'}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56ff1d2-9a3b-49c0-923b-80e7ffcc9ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:30 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Volume volume-319b3af3-c7ce-4874-8bf7-328dfc3817d6 (319b3af3-c7ce-4874-8bf7-328dfc3817d6): created successfully Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56ff1d2-9a3b-49c0-923b-80e7ffcc9ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Flow 'volume_create_manager' (f2461c54-e5fc-4824-81ec-e2360413a607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:30 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-82162f31-c242-41a8-9275-461e933bb555 tempest-VolumeDependencyTests-2108174611 None] Created volume successfully. Sep 09 18:32:30 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-76543a14-52c3-4d3e-b9fb-e9a9ae0f0880 1073741824" returned: 0 in 0.444s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-76543a14-52c3-4d3e-b9fb-e9a9ae0f0880 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:30 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-76543a14-52c3-4d3e-b9fb-e9a9ae0f0880 Sep 09 18:32:30 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:31 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-76543a14-52c3-4d3e-b9fb-e9a9ae0f0880" returned: 0 in 0.242s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647563190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0d25227-b1b2-41d1-9ad2-2241fc19f702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ca6b2e960a421fa01cc6cd47a41428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:30Z,use_quota=True,user_id='7af08b76357f43e587baf7b65d065371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Creating volume b0d25227-b1b2-41d1-9ad2-2241fc19f702 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:32:31 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b48c863-ac80-443a-a885-3fec108a4187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76543a14-52c3-4d3e-b9fb-e9a9ae0f0880', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:31 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702 1073741824 Sep 09 18:32:31 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c25313c-59cc-4771-aeec-5ca2addaabe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:31 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Volume volume-76543a14-52c3-4d3e-b9fb-e9a9ae0f0880 (76543a14-52c3-4d3e-b9fb-e9a9ae0f0880): created successfully Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c25313c-59cc-4771-aeec-5ca2addaabe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Flow 'volume_create_manager' (4129ec77-9b12-4d58-87a9-1e23e616f9b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:31 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d5e46145-f04f-4ee4-9fb4-c53721cf2711 tempest-ProjectReaderTests-673545270 None] Created volume successfully. Sep 09 18:32:31 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702 1073741824" returned: 0 in 0.417s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-47d2638b-0d8a-4eb6-8516-97a52e3ffa17 tempest-VolumeDependencyTests-2108174611 None] Acquiring lock "cinder-c996e636-96e2-490e-99db-4caa3d838499-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:31 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702 Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-47d2638b-0d8a-4eb6-8516-97a52e3ffa17 tempest-VolumeDependencyTests-2108174611 None] Lock "cinder-c996e636-96e2-490e-99db-4caa3d838499-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:31 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-47d2638b-0d8a-4eb6-8516-97a52e3ffa17 tempest-VolumeDependencyTests-2108174611 None] Acquiring lock "cinder-quobyte-015c7c78-d87a-421b-9975-855ff1a7643b" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-47d2638b-0d8a-4eb6-8516-97a52e3ffa17 tempest-VolumeDependencyTests-2108174611 None] Lock "cinder-quobyte-015c7c78-d87a-421b-9975-855ff1a7643b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-47d2638b-0d8a-4eb6-8516-97a52e3ffa17 tempest-VolumeDependencyTests-2108174611 None] Acquiring lock "cinder-quobyte-c996e636-96e2-490e-99db-4caa3d838499" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-47d2638b-0d8a-4eb6-8516-97a52e3ffa17 tempest-VolumeDependencyTests-2108174611 None] Lock "cinder-quobyte-c996e636-96e2-490e-99db-4caa3d838499" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-47d2638b-0d8a-4eb6-8516-97a52e3ffa17 tempest-VolumeDependencyTests-2108174611 None] Deleting offline snapshot c996e636-96e2-490e-99db-4caa3d838499 of volume 015c7c78-d87a-421b-9975-855ff1a7643b {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-47d2638b-0d8a-4eb6-8516-97a52e3ffa17 tempest-VolumeDependencyTests-2108174611 None] snapshot_file for this snap is: volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce07154-d2af-4171-a87d-2d5cdc2513f6]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-47d2638b-0d8a-4eb6-8516-97a52e3ffa17 tempest-VolumeDependencyTests-2108174611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:31 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499 Sep 09 18:32:31 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:31 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702" returned: 0 in 0.285s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26841b17-a10f-4a4d-9830-2f856e2ca6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521d299f-1cdc-4cd8-aad3-8b9bf67a5975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:31 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Volume volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702 (b0d25227-b1b2-41d1-9ad2-2241fc19f702): created successfully Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521d299f-1cdc-4cd8-aad3-8b9bf67a5975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Flow 'volume_create_manager' (f5e845f9-02f3-4e79-ba7a-cd14a6f0abf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:31 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-8af5b2b6-3ea6-4a40-bf41-cfffedfe0712 tempest-CreateVolumesFromSnapshotTest-298434787 None] Created volume successfully. Sep 09 18:32:32 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-47d2638b-0d8a-4eb6-8516-97a52e3ffa17 tempest-VolumeDependencyTests-2108174611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499" returned: 0 in 0.414s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:32 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-47d2638b-0d8a-4eb6-8516-97a52e3ffa17 tempest-VolumeDependencyTests-2108174611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-015c7c78-d87a-421b-9975-855ff1a7643b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:32:32 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abf7fed-fd40-41ce-8013-d53cf8343456]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-47d2638b-0d8a-4eb6-8516-97a52e3ffa17 tempest-VolumeDependencyTests-2108174611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:32 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b Sep 09 18:32:32 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ba4178e4-5483-4ad4-a4d2-c55e4315b11f tempest-ProjectReaderTests-673545270 None] Acquiring lock "cinder-76543a14-52c3-4d3e-b9fb-e9a9ae0f0880-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ba4178e4-5483-4ad4-a4d2-c55e4315b11f tempest-ProjectReaderTests-673545270 None] Lock "cinder-76543a14-52c3-4d3e-b9fb-e9a9ae0f0880-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ba4178e4-5483-4ad4-a4d2-c55e4315b11f tempest-ProjectReaderTests-673545270 None] Acquiring lock "cinder-quobyte-76543a14-52c3-4d3e-b9fb-e9a9ae0f0880" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ba4178e4-5483-4ad4-a4d2-c55e4315b11f tempest-ProjectReaderTests-673545270 None] Lock "cinder-quobyte-76543a14-52c3-4d3e-b9fb-e9a9ae0f0880" acquired by "delete_volume" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:32 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26bffee-e7c3-4896-95e7-020a4e633ca7]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ba4178e4-5483-4ad4-a4d2-c55e4315b11f tempest-ProjectReaderTests-673545270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-76543a14-52c3-4d3e-b9fb-e9a9ae0f0880 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:32 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-76543a14-52c3-4d3e-b9fb-e9a9ae0f0880 Sep 09 18:32:32 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:32 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-47d2638b-0d8a-4eb6-8516-97a52e3ffa17 tempest-VolumeDependencyTests-2108174611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b" returned: 0 in 0.635s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-47d2638b-0d8a-4eb6-8516-97a52e3ffa17 tempest-VolumeDependencyTests-2108174611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:32 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499 Sep 09 18:32:32 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:32 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ba4178e4-5483-4ad4-a4d2-c55e4315b11f tempest-ProjectReaderTests-673545270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-76543a14-52c3-4d3e-b9fb-e9a9ae0f0880" returned: 0 in 0.423s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ba4178e4-5483-4ad4-a4d2-c55e4315b11f tempest-ProjectReaderTests-673545270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-76543a14-52c3-4d3e-b9fb-e9a9ae0f0880 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:33 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-76543a14-52c3-4d3e-b9fb-e9a9ae0f0880 Sep 09 18:32:33 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:33 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-47d2638b-0d8a-4eb6-8516-97a52e3ffa17 tempest-VolumeDependencyTests-2108174611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499" returned: 0 in 0.362s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-47d2638b-0d8a-4eb6-8516-97a52e3ffa17 tempest-VolumeDependencyTests-2108174611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:33 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499 Sep 09 18:32:33 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5dd89fd3-716e-4384-b5da-db115deee76d tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5dd89fd3-716e-4384-b5da-db115deee76d tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-5dd89fd3-716e-4384-b5da-db115deee76d tempest-CreateVolumesFromSnapshotTest-298434787 None] Creating offline snapshot 14dd1343-0bf7-404c-99cc-5a83037e44f6 of volume b0d25227-b1b2-41d1-9ad2-2241fc19f702 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8d99ed-70c9-4746-99d6-e6ef4876d972]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5dd89fd3-716e-4384-b5da-db115deee76d tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:33 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ba4178e4-5483-4ad4-a4d2-c55e4315b11f tempest-ProjectReaderTests-673545270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-76543a14-52c3-4d3e-b9fb-e9a9ae0f0880" returned: 0 in 0.306s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ba4178e4-5483-4ad4-a4d2-c55e4315b11f tempest-ProjectReaderTests-673545270 None] Lock "cinder-quobyte-76543a14-52c3-4d3e-b9fb-e9a9ae0f0880" released by "delete_volume" :: held 0.783s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-ba4178e4-5483-4ad4-a4d2-c55e4315b11f tempest-ProjectReaderTests-673545270 None] Created reservations ['a710b5cb-7fe6-4092-95ef-14a85c0bae9b', 'c5a6c631-83c6-4cd5-a711-69b4049f960e', 'ae23842b-77c6-4372-ba5a-094b47d4188a', '04a0e950-9a63-46c7-8702-cdfa4804cb0d'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:33 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702 Sep 09 18:32:33 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ba4178e4-5483-4ad4-a4d2-c55e4315b11f tempest-ProjectReaderTests-673545270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ba4178e4-5483-4ad4-a4d2-c55e4315b11f tempest-ProjectReaderTests-673545270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ba4178e4-5483-4ad4-a4d2-c55e4315b11f tempest-ProjectReaderTests-673545270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ba4178e4-5483-4ad4-a4d2-c55e4315b11f tempest-ProjectReaderTests-673545270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ba4178e4-5483-4ad4-a4d2-c55e4315b11f tempest-ProjectReaderTests-673545270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ba4178e4-5483-4ad4-a4d2-c55e4315b11f tempest-ProjectReaderTests-673545270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:33 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-47d2638b-0d8a-4eb6-8516-97a52e3ffa17 tempest-VolumeDependencyTests-2108174611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b.c996e636-96e2-490e-99db-4caa3d838499" returned: 0 in 0.271s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:33 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:33 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-47d2638b-0d8a-4eb6-8516-97a52e3ffa17 tempest-VolumeDependencyTests-2108174611 None] Lock "cinder-quobyte-c996e636-96e2-490e-99db-4caa3d838499" released by "_delete_snapshot" :: held 1.799s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-47d2638b-0d8a-4eb6-8516-97a52e3ffa17 tempest-VolumeDependencyTests-2108174611 None] Lock "cinder-quobyte-015c7c78-d87a-421b-9975-855ff1a7643b" released by "delete_snapshot" :: held 1.826s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-47d2638b-0d8a-4eb6-8516-97a52e3ffa17 tempest-VolumeDependencyTests-2108174611 None] Created reservations ['fd18c2bb-497d-4680-9101-dabcffdcab66', 'a5c7e573-7d17-4373-b267-3e8f2eb5c3b4', '634e4b9e-6ae4-485d-b6df-22d60bc7d754', '98c9b11d-1941-44bc-b7e5-1dee252161b2'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:33 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-47d2638b-0d8a-4eb6-8516-97a52e3ffa17 tempest-VolumeDependencyTests-2108174611 None] Delete snapshot completed successfully. Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-47d2638b-0d8a-4eb6-8516-97a52e3ffa17 tempest-VolumeDependencyTests-2108174611 None] Lock "cinder-c996e636-96e2-490e-99db-4caa3d838499-delete_snapshot" released by "delete_snapshot" :: held 2.025s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:33 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5dd89fd3-716e-4384-b5da-db115deee76d tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702" returned: 0 in 0.453s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5dd89fd3-716e-4384-b5da-db115deee76d tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.14dd1343-0bf7-404c-99cc-5a83037e44f6 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:33 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ba4178e4-5483-4ad4-a4d2-c55e4315b11f tempest-ProjectReaderTests-673545270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.305s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-ba4178e4-5483-4ad4-a4d2-c55e4315b11f tempest-ProjectReaderTests-673545270 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:33 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ba4178e4-5483-4ad4-a4d2-c55e4315b11f tempest-ProjectReaderTests-673545270 None] Deleted volume successfully. Sep 09 18:32:33 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.14dd1343-0bf7-404c-99cc-5a83037e44f6 1G Sep 09 18:32:33 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ba4178e4-5483-4ad4-a4d2-c55e4315b11f tempest-ProjectReaderTests-673545270 None] Lock "cinder-76543a14-52c3-4d3e-b9fb-e9a9ae0f0880-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2a7e8e3a-7217-4d85-a97e-d99d8aec39bc tempest-VolumeDependencyTests-2108174611 None] Acquiring lock "cinder-015c7c78-d87a-421b-9975-855ff1a7643b-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2a7e8e3a-7217-4d85-a97e-d99d8aec39bc tempest-VolumeDependencyTests-2108174611 None] Lock "cinder-015c7c78-d87a-421b-9975-855ff1a7643b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2a7e8e3a-7217-4d85-a97e-d99d8aec39bc tempest-VolumeDependencyTests-2108174611 None] Acquiring lock "cinder-quobyte-015c7c78-d87a-421b-9975-855ff1a7643b" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2a7e8e3a-7217-4d85-a97e-d99d8aec39bc tempest-VolumeDependencyTests-2108174611 None] Lock "cinder-quobyte-015c7c78-d87a-421b-9975-855ff1a7643b" acquired by "delete_volume" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:34 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0cc0b6-a78c-4100-8b63-e5e2add8047e]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a7e8e3a-7217-4d85-a97e-d99d8aec39bc tempest-VolumeDependencyTests-2108174611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:34 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b Sep 09 18:32:34 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:34 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5dd89fd3-716e-4384-b5da-db115deee76d tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.14dd1343-0bf7-404c-99cc-5a83037e44f6 1G" returned: 0 in 0.606s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5dd89fd3-716e-4384-b5da-db115deee76d tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.14dd1343-0bf7-404c-99cc-5a83037e44f6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:34 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.14dd1343-0bf7-404c-99cc-5a83037e44f6 Sep 09 18:32:34 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:34 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a7e8e3a-7217-4d85-a97e-d99d8aec39bc tempest-VolumeDependencyTests-2108174611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b" returned: 0 in 0.430s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a7e8e3a-7217-4d85-a97e-d99d8aec39bc tempest-VolumeDependencyTests-2108174611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:34 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b Sep 09 18:32:34 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:34 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5dd89fd3-716e-4384-b5da-db115deee76d tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.14dd1343-0bf7-404c-99cc-5a83037e44f6" returned: 0 in 0.362s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:34 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-5dd89fd3-716e-4384-b5da-db115deee76d tempest-CreateVolumesFromSnapshotTest-298434787 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.14dd1343-0bf7-404c-99cc-5a83037e44f6 is being set with open permissions: ugo+rw Sep 09 18:32:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5dd89fd3-716e-4384-b5da-db115deee76d tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.14dd1343-0bf7-404c-99cc-5a83037e44f6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:34 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.14dd1343-0bf7-404c-99cc-5a83037e44f6 Sep 09 18:32:34 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:34 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a7e8e3a-7217-4d85-a97e-d99d8aec39bc tempest-VolumeDependencyTests-2108174611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-015c7c78-d87a-421b-9975-855ff1a7643b" returned: 0 in 0.297s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2a7e8e3a-7217-4d85-a97e-d99d8aec39bc tempest-VolumeDependencyTests-2108174611 None] Lock "cinder-quobyte-015c7c78-d87a-421b-9975-855ff1a7643b" released by "delete_volume" :: held 0.811s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:34 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-2a7e8e3a-7217-4d85-a97e-d99d8aec39bc tempest-VolumeDependencyTests-2108174611 None] Created reservations ['e55771a0-237b-4fa7-996d-629648cb81cf', 'c4dfd9c7-c93f-4728-9727-e9155fda61d5', 'b185cea2-5e41-43d7-857c-c96fe68faa31', '63d0e778-4aef-4396-96ff-373114f6a573'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2a7e8e3a-7217-4d85-a97e-d99d8aec39bc tempest-VolumeDependencyTests-2108174611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2a7e8e3a-7217-4d85-a97e-d99d8aec39bc tempest-VolumeDependencyTests-2108174611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2a7e8e3a-7217-4d85-a97e-d99d8aec39bc tempest-VolumeDependencyTests-2108174611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:35 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-2a7e8e3a-7217-4d85-a97e-d99d8aec39bc tempest-VolumeDependencyTests-2108174611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-2a7e8e3a-7217-4d85-a97e-d99d8aec39bc tempest-VolumeDependencyTests-2108174611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a7e8e3a-7217-4d85-a97e-d99d8aec39bc tempest-VolumeDependencyTests-2108174611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5dd89fd3-716e-4384-b5da-db115deee76d tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.14dd1343-0bf7-404c-99cc-5a83037e44f6" returned: 0 in 0.362s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:35 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:35 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5dd89fd3-716e-4384-b5da-db115deee76d tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:35 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.info Sep 09 18:32:35 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1ef42479-9cf9-4c8b-94c0-858963e877a3 tempest-VolumeDependencyTests-2108174611 None] Acquiring lock "cinder-319b3af3-c7ce-4874-8bf7-328dfc3817d6-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1ef42479-9cf9-4c8b-94c0-858963e877a3 tempest-VolumeDependencyTests-2108174611 None] Lock "cinder-319b3af3-c7ce-4874-8bf7-328dfc3817d6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1ef42479-9cf9-4c8b-94c0-858963e877a3 tempest-VolumeDependencyTests-2108174611 None] Acquiring lock "cinder-quobyte-319b3af3-c7ce-4874-8bf7-328dfc3817d6" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1ef42479-9cf9-4c8b-94c0-858963e877a3 tempest-VolumeDependencyTests-2108174611 None] Lock "cinder-quobyte-319b3af3-c7ce-4874-8bf7-328dfc3817d6" acquired by "delete_volume" :: waited 0.025s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b97c0ca-9baa-4980-91f4-1137017ca44f]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1ef42479-9cf9-4c8b-94c0-858963e877a3 tempest-VolumeDependencyTests-2108174611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-319b3af3-c7ce-4874-8bf7-328dfc3817d6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:35 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2a7e8e3a-7217-4d85-a97e-d99d8aec39bc tempest-VolumeDependencyTests-2108174611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.461s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-2a7e8e3a-7217-4d85-a97e-d99d8aec39bc tempest-VolumeDependencyTests-2108174611 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:35 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-2a7e8e3a-7217-4d85-a97e-d99d8aec39bc tempest-VolumeDependencyTests-2108174611 None] Deleted volume successfully. Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2a7e8e3a-7217-4d85-a97e-d99d8aec39bc tempest-VolumeDependencyTests-2108174611 None] Lock "cinder-015c7c78-d87a-421b-9975-855ff1a7643b-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:35 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5dd89fd3-716e-4384-b5da-db115deee76d tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.info" returned: 0 in 0.426s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:35 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-5dd89fd3-716e-4384-b5da-db115deee76d tempest-CreateVolumesFromSnapshotTest-298434787 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.info is being set with open permissions: ugo+rw Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5dd89fd3-716e-4384-b5da-db115deee76d tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:35 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-319b3af3-c7ce-4874-8bf7-328dfc3817d6 Sep 09 18:32:35 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:35 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.info Sep 09 18:32:35 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:35 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5dd89fd3-716e-4384-b5da-db115deee76d tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.info" returned: 0 in 0.328s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5dd89fd3-716e-4384-b5da-db115deee76d tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.673s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:35 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:35 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-5dd89fd3-716e-4384-b5da-db115deee76d tempest-CreateVolumesFromSnapshotTest-298434787 None] Create snapshot completed successfully Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1ef42479-9cf9-4c8b-94c0-858963e877a3 tempest-VolumeDependencyTests-2108174611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-319b3af3-c7ce-4874-8bf7-328dfc3817d6" returned: 0 in 0.561s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1ef42479-9cf9-4c8b-94c0-858963e877a3 tempest-VolumeDependencyTests-2108174611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-319b3af3-c7ce-4874-8bf7-328dfc3817d6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:35 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-319b3af3-c7ce-4874-8bf7-328dfc3817d6 Sep 09 18:32:35 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:36 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1ef42479-9cf9-4c8b-94c0-858963e877a3 tempest-VolumeDependencyTests-2108174611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-319b3af3-c7ce-4874-8bf7-328dfc3817d6" returned: 0 in 0.295s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1ef42479-9cf9-4c8b-94c0-858963e877a3 tempest-VolumeDependencyTests-2108174611 None] Lock "cinder-quobyte-319b3af3-c7ce-4874-8bf7-328dfc3817d6" released by "delete_volume" :: held 0.922s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:36 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-1ef42479-9cf9-4c8b-94c0-858963e877a3 tempest-VolumeDependencyTests-2108174611 None] Created reservations ['b4d02f7f-5b74-45e8-b5b7-1668ef82fccc', '8157535b-1e3e-4e59-b4cd-f3dcabda35f4', '4601b5dd-d24b-4ea8-bcd8-915bc6e74823', '1f7ad983-8b87-439a-b3cc-ad923b8aa5e3'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1ef42479-9cf9-4c8b-94c0-858963e877a3 tempest-VolumeDependencyTests-2108174611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1ef42479-9cf9-4c8b-94c0-858963e877a3 tempest-VolumeDependencyTests-2108174611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:36 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1ef42479-9cf9-4c8b-94c0-858963e877a3 tempest-VolumeDependencyTests-2108174611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:36 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1ef42479-9cf9-4c8b-94c0-858963e877a3 tempest-VolumeDependencyTests-2108174611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1ef42479-9cf9-4c8b-94c0-858963e877a3 tempest-VolumeDependencyTests-2108174611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1ef42479-9cf9-4c8b-94c0-858963e877a3 tempest-VolumeDependencyTests-2108174611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:36 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:36 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:36 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1ef42479-9cf9-4c8b-94c0-858963e877a3 tempest-VolumeDependencyTests-2108174611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.357s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:36 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-1ef42479-9cf9-4c8b-94c0-858963e877a3 tempest-VolumeDependencyTests-2108174611 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:36 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-1ef42479-9cf9-4c8b-94c0-858963e877a3 tempest-VolumeDependencyTests-2108174611 None] Deleted volume successfully. Sep 09 18:32:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1ef42479-9cf9-4c8b-94c0-858963e877a3 tempest-VolumeDependencyTests-2108174611 None] Lock "cinder-319b3af3-c7ce-4874-8bf7-328dfc3817d6-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Flow 'volume_create_manager' (553577a2-27b8-43f6-b109-80b5b3f809bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233d854f-4181-42d0-a858-0bc9d821c780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233d854f-4181-42d0-a858-0bc9d821c780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-173886619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ca6b2e960a421fa01cc6cd47a41428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:37Z,use_quota=True,user_id='7af08b76357f43e587baf7b65d065371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c98fa00-5569-4b5f-8aab-eb0ab8458377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c98fa00-5569-4b5f-8aab-eb0ab8458377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d61ecd-35f8-462f-8c04-cca2f3129462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d61ecd-35f8-462f-8c04-cca2f3129462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f', 'volume_name': 'volume-8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f8d656-50dd-486d-852f-67808690b28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f8d656-50dd-486d-852f-67808690b28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41929f36-091f-46b9-a520-386156c2cd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:37 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Volume 8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f', 'volume_size': 1} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-173886619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ca6b2e960a421fa01cc6cd47a41428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:37Z,use_quota=True,user_id='7af08b76357f43e587baf7b65d065371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Creating volume 8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:32:37 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:37 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f 1073741824 Sep 09 18:32:37 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Flow 'volume_create_manager' (9d54460c-43ce-4d41-9d01-7f2e80fe8263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c37df5c-580c-416a-8430-0801b4c275b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c37df5c-580c-416a-8430-0801b4c275b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-236373463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f814438-9f40-46e3-9704-3cecabf909fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ca6b2e960a421fa01cc6cd47a41428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:38Z,use_quota=True,user_id='7af08b76357f43e587baf7b65d065371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e98fc7-0452-4b03-b757-0cd882e45174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e98fc7-0452-4b03-b757-0cd882e45174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c95af8-d7dc-4e05-b8ef-3b87527ba8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c95af8-d7dc-4e05-b8ef-3b87527ba8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f814438-9f40-46e3-9704-3cecabf909fd', 'volume_name': 'volume-9f814438-9f40-46e3-9704-3cecabf909fd', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08cadce5-0a02-451c-b7b1-fa6b038ba673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08cadce5-0a02-451c-b7b1-fa6b038ba673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc98e80-8867-45d7-84f8-99674a50f309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:37 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Volume 9f814438-9f40-46e3-9704-3cecabf909fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f814438-9f40-46e3-9704-3cecabf909fd', 'volume_size': 1} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f 1073741824" returned: 0 in 0.656s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:37 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:37 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f Sep 09 18:32:37 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:38 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f" returned: 0 in 0.380s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.463s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-236373463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f814438-9f40-46e3-9704-3cecabf909fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ca6b2e960a421fa01cc6cd47a41428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:38Z,use_quota=True,user_id='7af08b76357f43e587baf7b65d065371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Creating volume 9f814438-9f40-46e3-9704-3cecabf909fd {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:32:38 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f814438-9f40-46e3-9704-3cecabf909fd 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:38 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f814438-9f40-46e3-9704-3cecabf909fd 1073741824 Sep 09 18:32:38 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41929f36-091f-46b9-a520-386156c2cd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2420d9d6-973e-4a38-ad80-d68a790cdbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:38 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Volume volume-8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f (8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f): created successfully Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2420d9d6-973e-4a38-ad80-d68a790cdbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Flow 'volume_create_manager' (553577a2-27b8-43f6-b109-80b5b3f809bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Flow 'volume_create_manager' (3a09d0f2-76c5-436e-8f01-5032a573e0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df899800-9fef-48b5-9abd-bc2b4679d091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:38 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-045f513a-59c6-4f5a-8d33-c4a4b5656638 tempest-CreateVolumesFromSnapshotTest-298434787 None] Created volume successfully. Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df899800-9fef-48b5-9abd-bc2b4679d091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1692772634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75148e42-dbe2-41f7-a8d8-ed508ccbbc43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ca6b2e960a421fa01cc6cd47a41428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:38Z,use_quota=True,user_id='7af08b76357f43e587baf7b65d065371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d093fdb8-67b4-4648-86e4-2c4e15e9aa51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d093fdb8-67b4-4648-86e4-2c4e15e9aa51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e076bc5c-0c77-4d26-90e3-48954cd253b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e076bc5c-0c77-4d26-90e3-48954cd253b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75148e42-dbe2-41f7-a8d8-ed508ccbbc43', 'volume_name': 'volume-75148e42-dbe2-41f7-a8d8-ed508ccbbc43', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657c83cf-70c5-404f-ba64-b36958f7780a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657c83cf-70c5-404f-ba64-b36958f7780a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5fc37e-15d3-4312-be6c-bda7c406c5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:38 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Volume 75148e42-dbe2-41f7-a8d8-ed508ccbbc43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75148e42-dbe2-41f7-a8d8-ed508ccbbc43', 'volume_size': 1} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Flow 'volume_create_manager' (c23461d2-adad-4f59-adf3-4ae46c114c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ed7a57-d1d0-4713-97d0-95657dbeea17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ed7a57-d1d0-4713-97d0-95657dbeea17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1099622113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d02f5fee-db19-4ad0-b79d-0e0f68b3bca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ca6b2e960a421fa01cc6cd47a41428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:39Z,use_quota=True,user_id='7af08b76357f43e587baf7b65d065371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661401e4-f378-4541-9bfe-3e1cb83b58b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661401e4-f378-4541-9bfe-3e1cb83b58b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37906b42-6b6d-48df-8648-0eba171db68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37906b42-6b6d-48df-8648-0eba171db68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd02f5fee-db19-4ad0-b79d-0e0f68b3bca0', 'volume_name': 'volume-d02f5fee-db19-4ad0-b79d-0e0f68b3bca0', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb785aa8-d5dd-457d-80f8-671c6665621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb785aa8-d5dd-457d-80f8-671c6665621c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ea416d-36dc-4cea-9bf9-dc951c0c9081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:38 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Volume d02f5fee-db19-4ad0-b79d-0e0f68b3bca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d02f5fee-db19-4ad0-b79d-0e0f68b3bca0', 'volume_size': 1} Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:38 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f814438-9f40-46e3-9704-3cecabf909fd 1073741824" returned: 0 in 0.690s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f814438-9f40-46e3-9704-3cecabf909fd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:39 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f814438-9f40-46e3-9704-3cecabf909fd Sep 09 18:32:39 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:39 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f814438-9f40-46e3-9704-3cecabf909fd" returned: 0 in 0.442s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.774s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1692772634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75148e42-dbe2-41f7-a8d8-ed508ccbbc43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ca6b2e960a421fa01cc6cd47a41428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:38Z,use_quota=True,user_id='7af08b76357f43e587baf7b65d065371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Creating volume 75148e42-dbe2-41f7-a8d8-ed508ccbbc43 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:32:39 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75148e42-dbe2-41f7-a8d8-ed508ccbbc43 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:39 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75148e42-dbe2-41f7-a8d8-ed508ccbbc43 1073741824 Sep 09 18:32:39 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc98e80-8867-45d7-84f8-99674a50f309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f814438-9f40-46e3-9704-3cecabf909fd', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cac6aa-424f-41fe-9abe-8200d169d7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:39 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Volume volume-9f814438-9f40-46e3-9704-3cecabf909fd (9f814438-9f40-46e3-9704-3cecabf909fd): created successfully Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cac6aa-424f-41fe-9abe-8200d169d7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Flow 'volume_create_manager' (9d54460c-43ce-4d41-9d01-7f2e80fe8263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:39 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-169f8ec8-dfce-472e-aabb-42ba311aa02c tempest-CreateVolumesFromSnapshotTest-298434787 None] Created volume successfully. Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Flow 'volume_create_manager' (bf665ab6-c58b-4155-9253-26d1e113db75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d0b1fa-5aef-40c4-bfab-f61db3a34524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5d0b1fa-5aef-40c4-bfab-f61db3a34524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1358360694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b80c88a-7b4f-4fd8-a037-6b92fdb43d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ca6b2e960a421fa01cc6cd47a41428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:40Z,use_quota=True,user_id='7af08b76357f43e587baf7b65d065371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf12dab5-ae89-4621-9035-d2f8c61d7ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf12dab5-ae89-4621-9035-d2f8c61d7ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e4ad57-c841-4836-ac6e-6bb940f654dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7e4ad57-c841-4836-ac6e-6bb940f654dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b80c88a-7b4f-4fd8-a037-6b92fdb43d68', 'volume_name': 'volume-9b80c88a-7b4f-4fd8-a037-6b92fdb43d68', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de3024d-abaf-44b6-b1d7-dd35a731ed79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de3024d-abaf-44b6-b1d7-dd35a731ed79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad14500c-2cb9-4b59-900b-e42c3aca1646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:39 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Volume 9b80c88a-7b4f-4fd8-a037-6b92fdb43d68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b80c88a-7b4f-4fd8-a037-6b92fdb43d68', 'volume_size': 1} Sep 09 18:32:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:40 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75148e42-dbe2-41f7-a8d8-ed508ccbbc43 1073741824" returned: 0 in 0.651s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75148e42-dbe2-41f7-a8d8-ed508ccbbc43 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:40 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75148e42-dbe2-41f7-a8d8-ed508ccbbc43 Sep 09 18:32:40 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Flow 'volume_create_manager' (cd3fffdd-f3b0-4224-9144-e7cd2d2697ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:40 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa02a53b-e3c1-43b9-afd5-70594778689c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75148e42-dbe2-41f7-a8d8-ed508ccbbc43" returned: 0 in 0.293s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.549s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1099622113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d02f5fee-db19-4ad0-b79d-0e0f68b3bca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ca6b2e960a421fa01cc6cd47a41428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:39Z,use_quota=True,user_id='7af08b76357f43e587baf7b65d065371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Creating volume d02f5fee-db19-4ad0-b79d-0e0f68b3bca0 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:32:40 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d02f5fee-db19-4ad0-b79d-0e0f68b3bca0 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:40 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d02f5fee-db19-4ad0-b79d-0e0f68b3bca0 1073741824 Sep 09 18:32:40 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa02a53b-e3c1-43b9-afd5-70594778689c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-327018795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2285c4fc-9a00-459f-9c41-d9f8b10044ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f023df38d149cc9114f6c7c8815859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:40Z,use_quota=True,user_id='874e5d295c084bfc968ed296ad47be34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ad017b-e72d-4291-988c-41f9d90d3e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ad017b-e72d-4291-988c-41f9d90d3e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ee0758-2f9f-4c86-b1f0-ac5dc65e3c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ee0758-2f9f-4c86-b1f0-ac5dc65e3c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2285c4fc-9a00-459f-9c41-d9f8b10044ff', 'volume_name': 'volume-2285c4fc-9a00-459f-9c41-d9f8b10044ff', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f23a1ae-5c3d-47a0-86b8-674731607bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f23a1ae-5c3d-47a0-86b8-674731607bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cac38ec-d06f-472d-b578-accbc8e74abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:40 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Volume 2285c4fc-9a00-459f-9c41-d9f8b10044ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2285c4fc-9a00-459f-9c41-d9f8b10044ff', 'volume_size': 1} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5fc37e-15d3-4312-be6c-bda7c406c5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75148e42-dbe2-41f7-a8d8-ed508ccbbc43', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576157a7-3680-40e5-9820-97539bdc676c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:40 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Volume volume-75148e42-dbe2-41f7-a8d8-ed508ccbbc43 (75148e42-dbe2-41f7-a8d8-ed508ccbbc43): created successfully Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576157a7-3680-40e5-9820-97539bdc676c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:40 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Flow 'volume_create_manager' (3a09d0f2-76c5-436e-8f01-5032a573e0ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:40 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-fa7f8c10-cda5-48f2-900c-ea4c5d91a06e tempest-CreateVolumesFromSnapshotTest-298434787 None] Created volume successfully. Sep 09 18:32:41 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d02f5fee-db19-4ad0-b79d-0e0f68b3bca0 1073741824" returned: 0 in 0.610s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d02f5fee-db19-4ad0-b79d-0e0f68b3bca0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:41 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d02f5fee-db19-4ad0-b79d-0e0f68b3bca0 Sep 09 18:32:41 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:41 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d02f5fee-db19-4ad0-b79d-0e0f68b3bca0" returned: 0 in 0.258s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:41 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:32:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.590s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:41 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1358360694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b80c88a-7b4f-4fd8-a037-6b92fdb43d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ca6b2e960a421fa01cc6cd47a41428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:40Z,use_quota=True,user_id='7af08b76357f43e587baf7b65d065371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:32:41 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Creating volume 9b80c88a-7b4f-4fd8-a037-6b92fdb43d68 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:32:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:41 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:41 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:41 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:32:41 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:32:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9b80c88a-7b4f-4fd8-a037-6b92fdb43d68 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:41 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ea416d-36dc-4cea-9bf9-dc951c0c9081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d02f5fee-db19-4ad0-b79d-0e0f68b3bca0', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:41 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9b80c88a-7b4f-4fd8-a037-6b92fdb43d68 1073741824 Sep 09 18:32:41 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28dbba1-fde8-4170-9e38-ee8c9ab07da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:41 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:41 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Volume volume-d02f5fee-db19-4ad0-b79d-0e0f68b3bca0 (d02f5fee-db19-4ad0-b79d-0e0f68b3bca0): created successfully Sep 09 18:32:41 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28dbba1-fde8-4170-9e38-ee8c9ab07da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:41 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Flow 'volume_create_manager' (c23461d2-adad-4f59-adf3-4ae46c114c5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:41 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-775c70f9-4094-42f0-952b-f5286598f6ae tempest-CreateVolumesFromSnapshotTest-298434787 None] Created volume successfully. Sep 09 18:32:42 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9b80c88a-7b4f-4fd8-a037-6b92fdb43d68 1073741824" returned: 0 in 0.576s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9b80c88a-7b4f-4fd8-a037-6b92fdb43d68 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:42 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9b80c88a-7b4f-4fd8-a037-6b92fdb43d68 Sep 09 18:32:42 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:42 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9b80c88a-7b4f-4fd8-a037-6b92fdb43d68" returned: 0 in 0.288s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:32:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.710s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-327018795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2285c4fc-9a00-459f-9c41-d9f8b10044ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f023df38d149cc9114f6c7c8815859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:40Z,use_quota=True,user_id='874e5d295c084bfc968ed296ad47be34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:32:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Creating volume 2285c4fc-9a00-459f-9c41-d9f8b10044ff {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:32:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:32:42 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:32:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2285c4fc-9a00-459f-9c41-d9f8b10044ff 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad14500c-2cb9-4b59-900b-e42c3aca1646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b80c88a-7b4f-4fd8-a037-6b92fdb43d68', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:42 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2285c4fc-9a00-459f-9c41-d9f8b10044ff 1073741824 Sep 09 18:32:42 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d746e56-6c9a-4976-bab0-80e086a7c4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:42 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Volume volume-9b80c88a-7b4f-4fd8-a037-6b92fdb43d68 (9b80c88a-7b4f-4fd8-a037-6b92fdb43d68): created successfully Sep 09 18:32:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d746e56-6c9a-4976-bab0-80e086a7c4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Flow 'volume_create_manager' (bf665ab6-c58b-4155-9253-26d1e113db75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:42 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-30c4cb8f-ede2-41e1-af01-83c1fe2d3563 tempest-CreateVolumesFromSnapshotTest-298434787 None] Created volume successfully. Sep 09 18:32:42 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2285c4fc-9a00-459f-9c41-d9f8b10044ff 1073741824" returned: 0 in 0.467s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2285c4fc-9a00-459f-9c41-d9f8b10044ff {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:42 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2285c4fc-9a00-459f-9c41-d9f8b10044ff Sep 09 18:32:42 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:43 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d245c221-8a22-4324-b630-f044c22b85c2 tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "cinder-9b80c88a-7b4f-4fd8-a037-6b92fdb43d68-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2285c4fc-9a00-459f-9c41-d9f8b10044ff" returned: 0 in 0.280s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cac38ec-d06f-472d-b578-accbc8e74abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2285c4fc-9a00-459f-9c41-d9f8b10044ff', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba946b4-1fb2-450f-b232-08d36b4bd240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:43 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Volume volume-2285c4fc-9a00-459f-9c41-d9f8b10044ff (2285c4fc-9a00-459f-9c41-d9f8b10044ff): created successfully Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba946b4-1fb2-450f-b232-08d36b4bd240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Flow 'volume_create_manager' (cd3fffdd-f3b0-4224-9144-e7cd2d2697ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d245c221-8a22-4324-b630-f044c22b85c2 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-9b80c88a-7b4f-4fd8-a037-6b92fdb43d68-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:43 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-1499f86c-4337-4901-b4f4-09b6c8d9d0ef tempest-ProjectReaderTests-1608801743 None] Created volume successfully. Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:43 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:43 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d245c221-8a22-4324-b630-f044c22b85c2 tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "cinder-quobyte-9b80c88a-7b4f-4fd8-a037-6b92fdb43d68" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d245c221-8a22-4324-b630-f044c22b85c2 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-quobyte-9b80c88a-7b4f-4fd8-a037-6b92fdb43d68" acquired by "delete_volume" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdb55d8-2acf-40d4-9439-58143e51e95f]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d245c221-8a22-4324-b630-f044c22b85c2 tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9b80c88a-7b4f-4fd8-a037-6b92fdb43d68 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:43 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9b80c88a-7b4f-4fd8-a037-6b92fdb43d68 Sep 09 18:32:43 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:43 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.325s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 29 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:32:43 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d245c221-8a22-4324-b630-f044c22b85c2 tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9b80c88a-7b4f-4fd8-a037-6b92fdb43d68" returned: 0 in 0.585s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d245c221-8a22-4324-b630-f044c22b85c2 tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9b80c88a-7b4f-4fd8-a037-6b92fdb43d68 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:43 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9b80c88a-7b4f-4fd8-a037-6b92fdb43d68 Sep 09 18:32:43 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:44 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d245c221-8a22-4324-b630-f044c22b85c2 tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9b80c88a-7b4f-4fd8-a037-6b92fdb43d68" returned: 0 in 0.322s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-42d79da0-df42-4ef4-9bf8-cf306be137cb tempest-ProjectReaderTests-1608801743 None] Acquiring lock "cinder-2285c4fc-9a00-459f-9c41-d9f8b10044ff-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d245c221-8a22-4324-b630-f044c22b85c2 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-quobyte-9b80c88a-7b4f-4fd8-a037-6b92fdb43d68" released by "delete_volume" :: held 0.983s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-42d79da0-df42-4ef4-9bf8-cf306be137cb tempest-ProjectReaderTests-1608801743 None] Lock "cinder-2285c4fc-9a00-459f-9c41-d9f8b10044ff-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-42d79da0-df42-4ef4-9bf8-cf306be137cb tempest-ProjectReaderTests-1608801743 None] Acquiring lock "cinder-quobyte-2285c4fc-9a00-459f-9c41-d9f8b10044ff" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-42d79da0-df42-4ef4-9bf8-cf306be137cb tempest-ProjectReaderTests-1608801743 None] Lock "cinder-quobyte-2285c4fc-9a00-459f-9c41-d9f8b10044ff" acquired by "delete_volume" :: waited 0.033s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:44 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-d245c221-8a22-4324-b630-f044c22b85c2 tempest-CreateVolumesFromSnapshotTest-298434787 None] Created reservations ['33eb10a2-621b-4730-bc5e-9a9c200d18f2', 'af83092d-09c5-4afc-aefd-5440e39feb72', '8c77d42e-3053-4fd7-9d7f-6c3329da5a6b', 'a7151152-083c-4ef6-b053-8317afb84b80'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:44 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9451b224-6c7e-4831-8a37-dc59de09e2d0]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-42d79da0-df42-4ef4-9bf8-cf306be137cb tempest-ProjectReaderTests-1608801743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2285c4fc-9a00-459f-9c41-d9f8b10044ff {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d245c221-8a22-4324-b630-f044c22b85c2 tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d245c221-8a22-4324-b630-f044c22b85c2 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:44 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d245c221-8a22-4324-b630-f044c22b85c2 tempest-CreateVolumesFromSnapshotTest-298434787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:44 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d245c221-8a22-4324-b630-f044c22b85c2 tempest-CreateVolumesFromSnapshotTest-298434787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d245c221-8a22-4324-b630-f044c22b85c2 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d245c221-8a22-4324-b630-f044c22b85c2 tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:44 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:44 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:44 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2285c4fc-9a00-459f-9c41-d9f8b10044ff Sep 09 18:32:44 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:44 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d245c221-8a22-4324-b630-f044c22b85c2 tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.339s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:44 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-d245c221-8a22-4324-b630-f044c22b85c2 tempest-CreateVolumesFromSnapshotTest-298434787 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:44 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d245c221-8a22-4324-b630-f044c22b85c2 tempest-CreateVolumesFromSnapshotTest-298434787 None] Deleted volume successfully. Sep 09 18:32:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d245c221-8a22-4324-b630-f044c22b85c2 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-9b80c88a-7b4f-4fd8-a037-6b92fdb43d68-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:44 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-42d79da0-df42-4ef4-9bf8-cf306be137cb tempest-ProjectReaderTests-1608801743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2285c4fc-9a00-459f-9c41-d9f8b10044ff" returned: 0 in 0.519s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-42d79da0-df42-4ef4-9bf8-cf306be137cb tempest-ProjectReaderTests-1608801743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2285c4fc-9a00-459f-9c41-d9f8b10044ff {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:45 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2285c4fc-9a00-459f-9c41-d9f8b10044ff Sep 09 18:32:45 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:45 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-42d79da0-df42-4ef4-9bf8-cf306be137cb tempest-ProjectReaderTests-1608801743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-2285c4fc-9a00-459f-9c41-d9f8b10044ff" returned: 0 in 0.329s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-42d79da0-df42-4ef4-9bf8-cf306be137cb tempest-ProjectReaderTests-1608801743 None] Lock "cinder-quobyte-2285c4fc-9a00-459f-9c41-d9f8b10044ff" released by "delete_volume" :: held 0.909s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:45 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-42d79da0-df42-4ef4-9bf8-cf306be137cb tempest-ProjectReaderTests-1608801743 None] Created reservations ['34933169-b4a3-43e6-9c2b-630b77cb12f2', '8f444f1b-a045-4e01-a0c9-37f3aa08ec2f', '39294c4c-af94-422d-8bea-bd29112d83eb', '57e4b0a7-9762-4ab1-a021-3d0267b3e3c9'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-42d79da0-df42-4ef4-9bf8-cf306be137cb tempest-ProjectReaderTests-1608801743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-42d79da0-df42-4ef4-9bf8-cf306be137cb tempest-ProjectReaderTests-1608801743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-42d79da0-df42-4ef4-9bf8-cf306be137cb tempest-ProjectReaderTests-1608801743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-42d79da0-df42-4ef4-9bf8-cf306be137cb tempest-ProjectReaderTests-1608801743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-42d79da0-df42-4ef4-9bf8-cf306be137cb tempest-ProjectReaderTests-1608801743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-42d79da0-df42-4ef4-9bf8-cf306be137cb tempest-ProjectReaderTests-1608801743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:45 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:45 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-eef1ad75-5739-4612-b47b-91008f98f74a tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "cinder-d02f5fee-db19-4ad0-b79d-0e0f68b3bca0-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-eef1ad75-5739-4612-b47b-91008f98f74a tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-d02f5fee-db19-4ad0-b79d-0e0f68b3bca0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:45 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-42d79da0-df42-4ef4-9bf8-cf306be137cb tempest-ProjectReaderTests-1608801743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.349s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:45 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-42d79da0-df42-4ef4-9bf8-cf306be137cb tempest-ProjectReaderTests-1608801743 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:45 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-42d79da0-df42-4ef4-9bf8-cf306be137cb tempest-ProjectReaderTests-1608801743 None] Deleted volume successfully. Sep 09 18:32:45 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=215,cinder:UPDATE=272,cinder:INSERT=86,cinder:DELETE=23 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:32:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-eef1ad75-5739-4612-b47b-91008f98f74a tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "cinder-quobyte-d02f5fee-db19-4ad0-b79d-0e0f68b3bca0" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-42d79da0-df42-4ef4-9bf8-cf306be137cb tempest-ProjectReaderTests-1608801743 None] Lock "cinder-2285c4fc-9a00-459f-9c41-d9f8b10044ff-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-eef1ad75-5739-4612-b47b-91008f98f74a tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-quobyte-d02f5fee-db19-4ad0-b79d-0e0f68b3bca0" acquired by "delete_volume" :: waited 0.039s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:45 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc9208c-82a5-411b-b7ee-b19b1dfd131c]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eef1ad75-5739-4612-b47b-91008f98f74a tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d02f5fee-db19-4ad0-b79d-0e0f68b3bca0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:46 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d02f5fee-db19-4ad0-b79d-0e0f68b3bca0 Sep 09 18:32:46 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:46 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eef1ad75-5739-4612-b47b-91008f98f74a tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d02f5fee-db19-4ad0-b79d-0e0f68b3bca0" returned: 0 in 0.444s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eef1ad75-5739-4612-b47b-91008f98f74a tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d02f5fee-db19-4ad0-b79d-0e0f68b3bca0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:46 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d02f5fee-db19-4ad0-b79d-0e0f68b3bca0 Sep 09 18:32:46 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:46 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eef1ad75-5739-4612-b47b-91008f98f74a tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d02f5fee-db19-4ad0-b79d-0e0f68b3bca0" returned: 0 in 0.329s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:46 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-eef1ad75-5739-4612-b47b-91008f98f74a tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-quobyte-d02f5fee-db19-4ad0-b79d-0e0f68b3bca0" released by "delete_volume" :: held 0.833s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:46 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:UPDATE=303,cinder:SELECT=200,cinder:INSERT=64,cinder:DELETE=31 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:32:46 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-eef1ad75-5739-4612-b47b-91008f98f74a tempest-CreateVolumesFromSnapshotTest-298434787 None] Created reservations ['12dc1c6d-ccdd-460e-b762-29957786377e', 'b32910fa-1fb7-47c8-9d8c-693e593957a5', '4ca3bd44-d357-439d-8857-d6ba88069121', '291345de-0ea6-4fef-bd81-ff8be19d3c59'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-eef1ad75-5739-4612-b47b-91008f98f74a tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-eef1ad75-5739-4612-b47b-91008f98f74a tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-eef1ad75-5739-4612-b47b-91008f98f74a tempest-CreateVolumesFromSnapshotTest-298434787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-eef1ad75-5739-4612-b47b-91008f98f74a tempest-CreateVolumesFromSnapshotTest-298434787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-eef1ad75-5739-4612-b47b-91008f98f74a tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eef1ad75-5739-4612-b47b-91008f98f74a tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-69f46330-eeef-4e7d-bc75-b3b182e7bd5e tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "cinder-75148e42-dbe2-41f7-a8d8-ed508ccbbc43-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:47 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:47 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-69f46330-eeef-4e7d-bc75-b3b182e7bd5e tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-75148e42-dbe2-41f7-a8d8-ed508ccbbc43-delete_volume" acquired by "delete_volume" :: waited 0.160s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-69f46330-eeef-4e7d-bc75-b3b182e7bd5e tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "cinder-quobyte-75148e42-dbe2-41f7-a8d8-ed508ccbbc43" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Flow 'volume_create_manager' (d30c8635-e0a5-4d19-8240-72579841459a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f42d47-0669-4439-bc01-8acdb99f03ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-69f46330-eeef-4e7d-bc75-b3b182e7bd5e tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-quobyte-75148e42-dbe2-41f7-a8d8-ed508ccbbc43" acquired by "delete_volume" :: waited 0.072s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00f42d47-0669-4439-bc01-8acdb99f03ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1835297828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d3e60e-3241-462a-bcd1-3393faea45e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f023df38d149cc9114f6c7c8815859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:47Z,use_quota=True,user_id='874e5d295c084bfc968ed296ad47be34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5989e6ff-c54a-4096-970a-f7f53d9b2597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5989e6ff-c54a-4096-970a-f7f53d9b2597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:47 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8eec6d9-8036-4577-8c87-906f76fd998b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8eec6d9-8036-4577-8c87-906f76fd998b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25d3e60e-3241-462a-bcd1-3393faea45e7', 'volume_name': 'volume-25d3e60e-3241-462a-bcd1-3393faea45e7', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce8b6ed-d4ff-4bef-91c1-b66928be2dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce8b6ed-d4ff-4bef-91c1-b66928be2dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b87606e-739d-47ba-b097-e0a5185ed638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:47 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Volume 25d3e60e-3241-462a-bcd1-3393faea45e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25d3e60e-3241-462a-bcd1-3393faea45e7', 'volume_size': 1} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1835297828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d3e60e-3241-462a-bcd1-3393faea45e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6f023df38d149cc9114f6c7c8815859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:47Z,use_quota=True,user_id='874e5d295c084bfc968ed296ad47be34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Creating volume 25d3e60e-3241-462a-bcd1-3393faea45e7 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:32:47 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-25d3e60e-3241-462a-bcd1-3393faea45e7 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6236ccdd-1810-4f06-bbfa-d731c4fd5990]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-69f46330-eeef-4e7d-bc75-b3b182e7bd5e tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75148e42-dbe2-41f7-a8d8-ed508ccbbc43 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eef1ad75-5739-4612-b47b-91008f98f74a tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.503s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-eef1ad75-5739-4612-b47b-91008f98f74a tempest-CreateVolumesFromSnapshotTest-298434787 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:47 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-eef1ad75-5739-4612-b47b-91008f98f74a tempest-CreateVolumesFromSnapshotTest-298434787 None] Deleted volume successfully. Sep 09 18:32:47 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-25d3e60e-3241-462a-bcd1-3393faea45e7 1073741824 Sep 09 18:32:47 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:47 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-eef1ad75-5739-4612-b47b-91008f98f74a tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-d02f5fee-db19-4ad0-b79d-0e0f68b3bca0-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:47 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75148e42-dbe2-41f7-a8d8-ed508ccbbc43 Sep 09 18:32:47 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:48 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-69f46330-eeef-4e7d-bc75-b3b182e7bd5e tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75148e42-dbe2-41f7-a8d8-ed508ccbbc43" returned: 0 in 0.551s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-69f46330-eeef-4e7d-bc75-b3b182e7bd5e tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75148e42-dbe2-41f7-a8d8-ed508ccbbc43 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:48 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75148e42-dbe2-41f7-a8d8-ed508ccbbc43 Sep 09 18:32:48 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:48 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-25d3e60e-3241-462a-bcd1-3393faea45e7 1073741824" returned: 0 in 0.715s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-25d3e60e-3241-462a-bcd1-3393faea45e7 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:48 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-25d3e60e-3241-462a-bcd1-3393faea45e7 Sep 09 18:32:48 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:48 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-69f46330-eeef-4e7d-bc75-b3b182e7bd5e tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-75148e42-dbe2-41f7-a8d8-ed508ccbbc43" returned: 0 in 0.448s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-69f46330-eeef-4e7d-bc75-b3b182e7bd5e tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-quobyte-75148e42-dbe2-41f7-a8d8-ed508ccbbc43" released by "delete_volume" :: held 1.151s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:48 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-69f46330-eeef-4e7d-bc75-b3b182e7bd5e tempest-CreateVolumesFromSnapshotTest-298434787 None] Created reservations ['eb9523f5-2f28-480d-a798-88ba76134f9c', '4bd06b08-78e9-49c0-b9ce-6f32bd88ad82', 'cdba11aa-fa5b-4521-a0cb-28de0a2d326f', 'b0221113-6ae4-43c9-b5c7-bb97a4214a3a'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:48 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-25d3e60e-3241-462a-bcd1-3393faea45e7" returned: 0 in 0.490s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:32:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b87606e-739d-47ba-b097-e0a5185ed638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25d3e60e-3241-462a-bcd1-3393faea45e7', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf173f3e-5266-4f90-b075-50c8c30fd0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-69f46330-eeef-4e7d-bc75-b3b182e7bd5e tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-69f46330-eeef-4e7d-bc75-b3b182e7bd5e tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-69f46330-eeef-4e7d-bc75-b3b182e7bd5e tempest-CreateVolumesFromSnapshotTest-298434787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-69f46330-eeef-4e7d-bc75-b3b182e7bd5e tempest-CreateVolumesFromSnapshotTest-298434787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-69f46330-eeef-4e7d-bc75-b3b182e7bd5e tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-69f46330-eeef-4e7d-bc75-b3b182e7bd5e tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:48 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Volume volume-25d3e60e-3241-462a-bcd1-3393faea45e7 (25d3e60e-3241-462a-bcd1-3393faea45e7): created successfully Sep 09 18:32:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf173f3e-5266-4f90-b075-50c8c30fd0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:48 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:48 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:48 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Flow 'volume_create_manager' (d30c8635-e0a5-4d19-8240-72579841459a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:48 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-3e23f22c-051a-41a1-9909-c76953fd665e tempest-ProjectReaderTests-1608801743 None] Created volume successfully. Sep 09 18:32:49 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-69f46330-eeef-4e7d-bc75-b3b182e7bd5e tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.316s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:49 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-69f46330-eeef-4e7d-bc75-b3b182e7bd5e tempest-CreateVolumesFromSnapshotTest-298434787 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:49 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-69f46330-eeef-4e7d-bc75-b3b182e7bd5e tempest-CreateVolumesFromSnapshotTest-298434787 None] Deleted volume successfully. Sep 09 18:32:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-69f46330-eeef-4e7d-bc75-b3b182e7bd5e tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-75148e42-dbe2-41f7-a8d8-ed508ccbbc43-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-387202d4-df98-4270-bd91-8fda9cc79c0d tempest-ProjectReaderTests-1608801743 None] Acquiring lock "cinder-25d3e60e-3241-462a-bcd1-3393faea45e7-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-88404913-c9b1-4a16-b6d5-8e13be453d9c tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "cinder-9f814438-9f40-46e3-9704-3cecabf909fd-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-88404913-c9b1-4a16-b6d5-8e13be453d9c tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-9f814438-9f40-46e3-9704-3cecabf909fd-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-387202d4-df98-4270-bd91-8fda9cc79c0d tempest-ProjectReaderTests-1608801743 None] Lock "cinder-25d3e60e-3241-462a-bcd1-3393faea45e7-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-387202d4-df98-4270-bd91-8fda9cc79c0d tempest-ProjectReaderTests-1608801743 None] Acquiring lock "cinder-quobyte-25d3e60e-3241-462a-bcd1-3393faea45e7" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-88404913-c9b1-4a16-b6d5-8e13be453d9c tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "cinder-quobyte-9f814438-9f40-46e3-9704-3cecabf909fd" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-387202d4-df98-4270-bd91-8fda9cc79c0d tempest-ProjectReaderTests-1608801743 None] Lock "cinder-quobyte-25d3e60e-3241-462a-bcd1-3393faea45e7" acquired by "delete_volume" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-88404913-c9b1-4a16-b6d5-8e13be453d9c tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-quobyte-9f814438-9f40-46e3-9704-3cecabf909fd" acquired by "delete_volume" :: waited 0.031s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:49 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b242e8-6c69-4749-9c3d-20adcfd19e62]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-387202d4-df98-4270-bd91-8fda9cc79c0d tempest-ProjectReaderTests-1608801743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-25d3e60e-3241-462a-bcd1-3393faea45e7 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:49 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[87567393-ed3c-4209-a9ae-0128ae6d8cd5]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-88404913-c9b1-4a16-b6d5-8e13be453d9c tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f814438-9f40-46e3-9704-3cecabf909fd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:49 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-25d3e60e-3241-462a-bcd1-3393faea45e7 Sep 09 18:32:49 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:49 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f814438-9f40-46e3-9704-3cecabf909fd Sep 09 18:32:49 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:50 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-88404913-c9b1-4a16-b6d5-8e13be453d9c tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f814438-9f40-46e3-9704-3cecabf909fd" returned: 0 in 0.477s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:50 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-88404913-c9b1-4a16-b6d5-8e13be453d9c tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f814438-9f40-46e3-9704-3cecabf909fd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-387202d4-df98-4270-bd91-8fda9cc79c0d tempest-ProjectReaderTests-1608801743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-25d3e60e-3241-462a-bcd1-3393faea45e7" returned: 0 in 0.516s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-387202d4-df98-4270-bd91-8fda9cc79c0d tempest-ProjectReaderTests-1608801743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-25d3e60e-3241-462a-bcd1-3393faea45e7 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:50 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f814438-9f40-46e3-9704-3cecabf909fd Sep 09 18:32:50 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:50 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-25d3e60e-3241-462a-bcd1-3393faea45e7 Sep 09 18:32:50 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:50 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-88404913-c9b1-4a16-b6d5-8e13be453d9c tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-9f814438-9f40-46e3-9704-3cecabf909fd" returned: 0 in 0.296s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:50 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-387202d4-df98-4270-bd91-8fda9cc79c0d tempest-ProjectReaderTests-1608801743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-25d3e60e-3241-462a-bcd1-3393faea45e7" returned: 0 in 0.291s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-88404913-c9b1-4a16-b6d5-8e13be453d9c tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-quobyte-9f814438-9f40-46e3-9704-3cecabf909fd" released by "delete_volume" :: held 0.838s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-387202d4-df98-4270-bd91-8fda9cc79c0d tempest-ProjectReaderTests-1608801743 None] Lock "cinder-quobyte-25d3e60e-3241-462a-bcd1-3393faea45e7" released by "delete_volume" :: held 0.863s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:50 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-88404913-c9b1-4a16-b6d5-8e13be453d9c tempest-CreateVolumesFromSnapshotTest-298434787 None] Created reservations ['29d96485-1573-4e8b-b05f-948f4ca30884', '26d47aa1-2811-4140-b67d-2d8fdd7e9625', '8c75f8a7-2cd1-46c6-820a-ba0e3e981b36', '326add4d-c66e-4446-98e9-16fbedbc5332'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:50 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-387202d4-df98-4270-bd91-8fda9cc79c0d tempest-ProjectReaderTests-1608801743 None] Created reservations ['54c08598-23d9-4c37-bf33-7236b28a8a8c', '851d24ca-c3a4-40e9-9131-5bdb5e77a721', '6f2c7d0e-5a9d-42bc-9319-fc8632804f0a', '4ec2867f-d077-4d82-97ef-e2d309108e96'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-88404913-c9b1-4a16-b6d5-8e13be453d9c tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-88404913-c9b1-4a16-b6d5-8e13be453d9c tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-88404913-c9b1-4a16-b6d5-8e13be453d9c tempest-CreateVolumesFromSnapshotTest-298434787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-88404913-c9b1-4a16-b6d5-8e13be453d9c tempest-CreateVolumesFromSnapshotTest-298434787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-88404913-c9b1-4a16-b6d5-8e13be453d9c tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-88404913-c9b1-4a16-b6d5-8e13be453d9c tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:50 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:50 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-387202d4-df98-4270-bd91-8fda9cc79c0d tempest-ProjectReaderTests-1608801743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-387202d4-df98-4270-bd91-8fda9cc79c0d tempest-ProjectReaderTests-1608801743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-387202d4-df98-4270-bd91-8fda9cc79c0d tempest-ProjectReaderTests-1608801743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-387202d4-df98-4270-bd91-8fda9cc79c0d tempest-ProjectReaderTests-1608801743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-387202d4-df98-4270-bd91-8fda9cc79c0d tempest-ProjectReaderTests-1608801743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-387202d4-df98-4270-bd91-8fda9cc79c0d tempest-ProjectReaderTests-1608801743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:50 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:50 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:51 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-88404913-c9b1-4a16-b6d5-8e13be453d9c tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.347s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-88404913-c9b1-4a16-b6d5-8e13be453d9c tempest-CreateVolumesFromSnapshotTest-298434787 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:51 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-88404913-c9b1-4a16-b6d5-8e13be453d9c tempest-CreateVolumesFromSnapshotTest-298434787 None] Deleted volume successfully. Sep 09 18:32:51 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-387202d4-df98-4270-bd91-8fda9cc79c0d tempest-ProjectReaderTests-1608801743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.359s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-387202d4-df98-4270-bd91-8fda9cc79c0d tempest-ProjectReaderTests-1608801743 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-88404913-c9b1-4a16-b6d5-8e13be453d9c tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-9f814438-9f40-46e3-9704-3cecabf909fd-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:51 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-387202d4-df98-4270-bd91-8fda9cc79c0d tempest-ProjectReaderTests-1608801743 None] Deleted volume successfully. Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-387202d4-df98-4270-bd91-8fda9cc79c0d tempest-ProjectReaderTests-1608801743 None] Lock "cinder-25d3e60e-3241-462a-bcd1-3393faea45e7-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Flow 'volume_create_manager' (695d5c4d-9ece-4191-bb24-f252b8f406b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5691634d-35ab-410b-be45-52c85fa16944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5691634d-35ab-410b-be45-52c85fa16944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-545766233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3366c8c4-3e24-432a-b328-04f665c40078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16d9e4115144c68db4659423a5963a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:51Z,use_quota=True,user_id='b4c31a80b5c54f3eb121e7c39fe61f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ec1ab6-9875-40bc-b922-0189950cf989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ec1ab6-9875-40bc-b922-0189950cf989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b800b98a-9aa0-4207-a2af-a2c9a48c3251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b800b98a-9aa0-4207-a2af-a2c9a48c3251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3366c8c4-3e24-432a-b328-04f665c40078', 'volume_name': 'volume-3366c8c4-3e24-432a-b328-04f665c40078', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (152c4b58-4a57-41b0-8f35-ca11bd85f199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (152c4b58-4a57-41b0-8f35-ca11bd85f199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e09590c-947e-463c-ab18-9b81e7c11ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:51 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Volume 3366c8c4-3e24-432a-b328-04f665c40078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3366c8c4-3e24-432a-b328-04f665c40078', 'volume_size': 1} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-545766233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3366c8c4-3e24-432a-b328-04f665c40078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16d9e4115144c68db4659423a5963a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:32:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:32:51Z,use_quota=True,user_id='b4c31a80b5c54f3eb121e7c39fe61f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Creating volume 3366c8c4-3e24-432a-b328-04f665c40078 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:32:51 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:51 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078 1073741824 Sep 09 18:32:51 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ffe8ad2c-7001-46ef-a808-f7824cd2c4aa tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "cinder-8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ffe8ad2c-7001-46ef-a808-f7824cd2c4aa tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ffe8ad2c-7001-46ef-a808-f7824cd2c4aa tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "cinder-quobyte-8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ffe8ad2c-7001-46ef-a808-f7824cd2c4aa tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-quobyte-8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f" acquired by "delete_volume" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[4071787f-87e0-464d-a953-08406806c944]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ffe8ad2c-7001-46ef-a808-f7824cd2c4aa tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:51 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078 1073741824" returned: 0 in 0.576s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:52 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f Sep 09 18:32:52 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:52 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078 Sep 09 18:32:52 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:52 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078" returned: 0 in 0.335s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:32:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e09590c-947e-463c-ab18-9b81e7c11ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3366c8c4-3e24-432a-b328-04f665c40078', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:52 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b14db1-312d-414e-b0cf-02f29d32f7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:32:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ffe8ad2c-7001-46ef-a808-f7824cd2c4aa tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f" returned: 0 in 0.498s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ffe8ad2c-7001-46ef-a808-f7824cd2c4aa tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:52 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Volume volume-3366c8c4-3e24-432a-b328-04f665c40078 (3366c8c4-3e24-432a-b328-04f665c40078): created successfully Sep 09 18:32:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b14db1-312d-414e-b0cf-02f29d32f7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:32:52 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f Sep 09 18:32:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Flow 'volume_create_manager' (695d5c4d-9ece-4191-bb24-f252b8f406b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:32:52 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:52 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-195e0729-2d1e-45b4-8e70-6dd98ce02583 tempest-ProjectMemberTests-1445315730 None] Created volume successfully. Sep 09 18:32:52 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ffe8ad2c-7001-46ef-a808-f7824cd2c4aa tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f" returned: 0 in 0.286s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:52 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ffe8ad2c-7001-46ef-a808-f7824cd2c4aa tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-quobyte-8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f" released by "delete_volume" :: held 0.833s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:52 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-ffe8ad2c-7001-46ef-a808-f7824cd2c4aa tempest-CreateVolumesFromSnapshotTest-298434787 None] Created reservations ['81fc13ee-ba80-4815-b5a2-b47ee97b23c8', '3b847eb9-fc40-4f5d-9e35-26c63c28783f', '4b943bbb-dc25-4e9b-a9e1-0194f0f64516', '4d044136-4d08-43d8-9243-a3dc095d875b'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ffe8ad2c-7001-46ef-a808-f7824cd2c4aa tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ffe8ad2c-7001-46ef-a808-f7824cd2c4aa tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ffe8ad2c-7001-46ef-a808-f7824cd2c4aa tempest-CreateVolumesFromSnapshotTest-298434787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-ffe8ad2c-7001-46ef-a808-f7824cd2c4aa tempest-CreateVolumesFromSnapshotTest-298434787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ffe8ad2c-7001-46ef-a808-f7824cd2c4aa tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ffe8ad2c-7001-46ef-a808-f7824cd2c4aa tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:52 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:52 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:53 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1b50327d-2dc5-42ce-9f37-0193cf68ab47 tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "cinder-14dd1343-0bf7-404c-99cc-5a83037e44f6-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:53 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1b50327d-2dc5-42ce-9f37-0193cf68ab47 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-14dd1343-0bf7-404c-99cc-5a83037e44f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:53 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1b50327d-2dc5-42ce-9f37-0193cf68ab47 tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "cinder-quobyte-b0d25227-b1b2-41d1-9ad2-2241fc19f702" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:53 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1b50327d-2dc5-42ce-9f37-0193cf68ab47 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-quobyte-b0d25227-b1b2-41d1-9ad2-2241fc19f702" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:53 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1b50327d-2dc5-42ce-9f37-0193cf68ab47 tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "cinder-quobyte-14dd1343-0bf7-404c-99cc-5a83037e44f6" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:53 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1b50327d-2dc5-42ce-9f37-0193cf68ab47 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-quobyte-14dd1343-0bf7-404c-99cc-5a83037e44f6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-1b50327d-2dc5-42ce-9f37-0193cf68ab47 tempest-CreateVolumesFromSnapshotTest-298434787 None] Deleting offline snapshot 14dd1343-0bf7-404c-99cc-5a83037e44f6 of volume b0d25227-b1b2-41d1-9ad2-2241fc19f702 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:32:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-1b50327d-2dc5-42ce-9f37-0193cf68ab47 tempest-CreateVolumesFromSnapshotTest-298434787 None] snapshot_file for this snap is: volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.14dd1343-0bf7-404c-99cc-5a83037e44f6 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:32:53 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a14390d-97dd-4b81-a564-801a8d6081dc]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1b50327d-2dc5-42ce-9f37-0193cf68ab47 tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.14dd1343-0bf7-404c-99cc-5a83037e44f6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:53 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ffe8ad2c-7001-46ef-a808-f7824cd2c4aa tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.336s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:53 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.14dd1343-0bf7-404c-99cc-5a83037e44f6 Sep 09 18:32:53 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-ffe8ad2c-7001-46ef-a808-f7824cd2c4aa tempest-CreateVolumesFromSnapshotTest-298434787 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:53 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:53 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ffe8ad2c-7001-46ef-a808-f7824cd2c4aa tempest-CreateVolumesFromSnapshotTest-298434787 None] Deleted volume successfully. Sep 09 18:32:53 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ffe8ad2c-7001-46ef-a808-f7824cd2c4aa tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-8122e23c-2e43-4a4f-8fd4-1e680ac6cd2f-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:53 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1b50327d-2dc5-42ce-9f37-0193cf68ab47 tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.14dd1343-0bf7-404c-99cc-5a83037e44f6" returned: 0 in 0.480s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-1b50327d-2dc5-42ce-9f37-0193cf68ab47 tempest-CreateVolumesFromSnapshotTest-298434787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:32:53 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[758a82be-3dcc-4a9c-8a25-c985fada9d90]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1b50327d-2dc5-42ce-9f37-0193cf68ab47 tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:53 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702 Sep 09 18:32:53 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-dcfc2326-84a1-42ff-84fe-077968870e1e tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-dcfc2326-84a1-42ff-84fe-077968870e1e tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:54 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-dcfc2326-84a1-42ff-84fe-077968870e1e tempest-ProjectMemberTests-1445315730 None] Creating offline snapshot 74d4c65b-e71a-42a4-83d1-6cde3e00adc5 of volume 3366c8c4-3e24-432a-b328-04f665c40078 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:32:54 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[f699c34c-6c85-4cf8-b48f-c5671a67de90]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dcfc2326-84a1-42ff-84fe-077968870e1e tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:54 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1b50327d-2dc5-42ce-9f37-0193cf68ab47 tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702" returned: 0 in 0.546s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1b50327d-2dc5-42ce-9f37-0193cf68ab47 tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.14dd1343-0bf7-404c-99cc-5a83037e44f6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:54 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.14dd1343-0bf7-404c-99cc-5a83037e44f6 Sep 09 18:32:54 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:54 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078 Sep 09 18:32:54 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:54 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dcfc2326-84a1-42ff-84fe-077968870e1e tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078" returned: 0 in 0.406s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dcfc2326-84a1-42ff-84fe-077968870e1e tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.74d4c65b-e71a-42a4-83d1-6cde3e00adc5 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:54 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.74d4c65b-e71a-42a4-83d1-6cde3e00adc5 1G Sep 09 18:32:54 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:54 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1b50327d-2dc5-42ce-9f37-0193cf68ab47 tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.14dd1343-0bf7-404c-99cc-5a83037e44f6" returned: 0 in 0.396s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1b50327d-2dc5-42ce-9f37-0193cf68ab47 tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.14dd1343-0bf7-404c-99cc-5a83037e44f6 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:54 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.14dd1343-0bf7-404c-99cc-5a83037e44f6 Sep 09 18:32:54 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:54 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1b50327d-2dc5-42ce-9f37-0193cf68ab47 tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702.14dd1343-0bf7-404c-99cc-5a83037e44f6" returned: 0 in 0.258s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:54 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1b50327d-2dc5-42ce-9f37-0193cf68ab47 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-quobyte-14dd1343-0bf7-404c-99cc-5a83037e44f6" released by "_delete_snapshot" :: held 1.850s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:54 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1b50327d-2dc5-42ce-9f37-0193cf68ab47 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-quobyte-b0d25227-b1b2-41d1-9ad2-2241fc19f702" released by "delete_snapshot" :: held 1.877s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:55 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-1b50327d-2dc5-42ce-9f37-0193cf68ab47 tempest-CreateVolumesFromSnapshotTest-298434787 None] Created reservations ['6c3737d9-9ed8-45d7-9dfb-72da8a9b4fcc', 'c32fda12-eda8-4872-98bc-64cfd3ce26fc', '7e13a213-13ae-49eb-a61a-b5c94633e895', '137adc22-6ef0-44b2-8f7e-8890142b1856'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:55 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dcfc2326-84a1-42ff-84fe-077968870e1e tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.74d4c65b-e71a-42a4-83d1-6cde3e00adc5 1G" returned: 0 in 0.454s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dcfc2326-84a1-42ff-84fe-077968870e1e tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3366c8c4-3e24-432a-b328-04f665c40078 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.74d4c65b-e71a-42a4-83d1-6cde3e00adc5 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:55 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3366c8c4-3e24-432a-b328-04f665c40078 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.74d4c65b-e71a-42a4-83d1-6cde3e00adc5 Sep 09 18:32:55 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:55 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-1b50327d-2dc5-42ce-9f37-0193cf68ab47 tempest-CreateVolumesFromSnapshotTest-298434787 None] Delete snapshot completed successfully. Sep 09 18:32:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1b50327d-2dc5-42ce-9f37-0193cf68ab47 tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-14dd1343-0bf7-404c-99cc-5a83037e44f6-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5c4f9d49-2927-4382-b5dc-f0a9470ccfba tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "cinder-b0d25227-b1b2-41d1-9ad2-2241fc19f702-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5c4f9d49-2927-4382-b5dc-f0a9470ccfba tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-b0d25227-b1b2-41d1-9ad2-2241fc19f702-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5c4f9d49-2927-4382-b5dc-f0a9470ccfba tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "cinder-quobyte-b0d25227-b1b2-41d1-9ad2-2241fc19f702" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5c4f9d49-2927-4382-b5dc-f0a9470ccfba tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-quobyte-b0d25227-b1b2-41d1-9ad2-2241fc19f702" acquired by "delete_volume" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:55 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b81eef-1fb1-45fc-a0e2-8ec72320561c]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5c4f9d49-2927-4382-b5dc-f0a9470ccfba tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:55 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dcfc2326-84a1-42ff-84fe-077968870e1e tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3366c8c4-3e24-432a-b328-04f665c40078 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.74d4c65b-e71a-42a4-83d1-6cde3e00adc5" returned: 0 in 0.428s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:55 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-dcfc2326-84a1-42ff-84fe-077968870e1e tempest-ProjectMemberTests-1445315730 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.74d4c65b-e71a-42a4-83d1-6cde3e00adc5 is being set with open permissions: ugo+rw Sep 09 18:32:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dcfc2326-84a1-42ff-84fe-077968870e1e tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.74d4c65b-e71a-42a4-83d1-6cde3e00adc5 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:55 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.74d4c65b-e71a-42a4-83d1-6cde3e00adc5 Sep 09 18:32:55 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:55 devstack sudo[108175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702 Sep 09 18:32:55 devstack sudo[108175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:55 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dcfc2326-84a1-42ff-84fe-077968870e1e tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.74d4c65b-e71a-42a4-83d1-6cde3e00adc5" returned: 0 in 0.368s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dcfc2326-84a1-42ff-84fe-077968870e1e tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:55 devstack sudo[108175]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5c4f9d49-2927-4382-b5dc-f0a9470ccfba tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702" returned: 0 in 0.540s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5c4f9d49-2927-4382-b5dc-f0a9470ccfba tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:55 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.info Sep 09 18:32:55 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:55 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702 Sep 09 18:32:55 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:56 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dcfc2326-84a1-42ff-84fe-077968870e1e tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.info" returned: 0 in 0.311s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:56 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-dcfc2326-84a1-42ff-84fe-077968870e1e tempest-ProjectMemberTests-1445315730 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.info is being set with open permissions: ugo+rw Sep 09 18:32:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dcfc2326-84a1-42ff-84fe-077968870e1e tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:56 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5c4f9d49-2927-4382-b5dc-f0a9470ccfba tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-b0d25227-b1b2-41d1-9ad2-2241fc19f702" returned: 0 in 0.307s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:56 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.info Sep 09 18:32:56 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:56 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5c4f9d49-2927-4382-b5dc-f0a9470ccfba tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-quobyte-b0d25227-b1b2-41d1-9ad2-2241fc19f702" released by "delete_volume" :: held 0.921s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:56 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-5c4f9d49-2927-4382-b5dc-f0a9470ccfba tempest-CreateVolumesFromSnapshotTest-298434787 None] Created reservations ['3fb92b22-a583-4191-8462-2d973fa605e0', '526ab6e7-5c58-41fe-bb79-521a3d96eb03', 'b26126df-25b1-468f-9182-294ab874d487', 'a9e761d7-cdf9-43e8-87ae-c6046f386906'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5c4f9d49-2927-4382-b5dc-f0a9470ccfba tempest-CreateVolumesFromSnapshotTest-298434787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:32:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5c4f9d49-2927-4382-b5dc-f0a9470ccfba tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:32:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5c4f9d49-2927-4382-b5dc-f0a9470ccfba tempest-CreateVolumesFromSnapshotTest-298434787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:32:56 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5c4f9d49-2927-4382-b5dc-f0a9470ccfba tempest-CreateVolumesFromSnapshotTest-298434787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:32:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5c4f9d49-2927-4382-b5dc-f0a9470ccfba tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5c4f9d49-2927-4382-b5dc-f0a9470ccfba tempest-CreateVolumesFromSnapshotTest-298434787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:56 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:32:56 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:56 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dcfc2326-84a1-42ff-84fe-077968870e1e tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.info" returned: 0 in 0.331s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-dcfc2326-84a1-42ff-84fe-077968870e1e tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.414s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:32:56 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-dcfc2326-84a1-42ff-84fe-077968870e1e tempest-ProjectMemberTests-1445315730 None] Create snapshot completed successfully Sep 09 18:32:56 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5c4f9d49-2927-4382-b5dc-f0a9470ccfba tempest-CreateVolumesFromSnapshotTest-298434787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.282s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:56 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-5c4f9d49-2927-4382-b5dc-f0a9470ccfba tempest-CreateVolumesFromSnapshotTest-298434787 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:32:56 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-5c4f9d49-2927-4382-b5dc-f0a9470ccfba tempest-CreateVolumesFromSnapshotTest-298434787 None] Deleted volume successfully. Sep 09 18:32:56 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-5c4f9d49-2927-4382-b5dc-f0a9470ccfba tempest-CreateVolumesFromSnapshotTest-298434787 None] Lock "cinder-b0d25227-b1b2-41d1-9ad2-2241fc19f702-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:57 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2c55521c-6d32-44f9-9a3e-c581a487bc05 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-74d4c65b-e71a-42a4-83d1-6cde3e00adc5-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:57 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2c55521c-6d32-44f9-9a3e-c581a487bc05 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-74d4c65b-e71a-42a4-83d1-6cde3e00adc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:57 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2c55521c-6d32-44f9-9a3e-c581a487bc05 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-3366c8c4-3e24-432a-b328-04f665c40078" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:57 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2c55521c-6d32-44f9-9a3e-c581a487bc05 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-3366c8c4-3e24-432a-b328-04f665c40078" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:57 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2c55521c-6d32-44f9-9a3e-c581a487bc05 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-74d4c65b-e71a-42a4-83d1-6cde3e00adc5" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:57 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2c55521c-6d32-44f9-9a3e-c581a487bc05 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-74d4c65b-e71a-42a4-83d1-6cde3e00adc5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-2c55521c-6d32-44f9-9a3e-c581a487bc05 tempest-ProjectMemberTests-1445315730 None] Deleting offline snapshot 74d4c65b-e71a-42a4-83d1-6cde3e00adc5 of volume 3366c8c4-3e24-432a-b328-04f665c40078 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:32:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-2c55521c-6d32-44f9-9a3e-c581a487bc05 tempest-ProjectMemberTests-1445315730 None] snapshot_file for this snap is: volume-3366c8c4-3e24-432a-b328-04f665c40078.74d4c65b-e71a-42a4-83d1-6cde3e00adc5 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:32:57 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[738612df-56db-40bf-acf2-8d52a7031081]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2c55521c-6d32-44f9-9a3e-c581a487bc05 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.74d4c65b-e71a-42a4-83d1-6cde3e00adc5 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:57 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.74d4c65b-e71a-42a4-83d1-6cde3e00adc5 Sep 09 18:32:57 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:57 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2c55521c-6d32-44f9-9a3e-c581a487bc05 tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.74d4c65b-e71a-42a4-83d1-6cde3e00adc5" returned: 0 in 0.440s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:57 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-2c55521c-6d32-44f9-9a3e-c581a487bc05 tempest-ProjectMemberTests-1445315730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3366c8c4-3e24-432a-b328-04f665c40078(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:32:57 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fb0142-adb6-402d-8b89-a66783b5dc10]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2c55521c-6d32-44f9-9a3e-c581a487bc05 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:58 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078 Sep 09 18:32:58 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:58 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2c55521c-6d32-44f9-9a3e-c581a487bc05 tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078" returned: 0 in 0.485s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2c55521c-6d32-44f9-9a3e-c581a487bc05 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.74d4c65b-e71a-42a4-83d1-6cde3e00adc5 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:58 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.74d4c65b-e71a-42a4-83d1-6cde3e00adc5 Sep 09 18:32:58 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:58 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2c55521c-6d32-44f9-9a3e-c581a487bc05 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.74d4c65b-e71a-42a4-83d1-6cde3e00adc5" returned: 0 in 0.437s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2c55521c-6d32-44f9-9a3e-c581a487bc05 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.74d4c65b-e71a-42a4-83d1-6cde3e00adc5 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:58 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.74d4c65b-e71a-42a4-83d1-6cde3e00adc5 Sep 09 18:32:58 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:32:59 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Sep 09 18:32:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2c55521c-6d32-44f9-9a3e-c581a487bc05 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078.74d4c65b-e71a-42a4-83d1-6cde3e00adc5" returned: 0 in 0.296s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:32:59 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2c55521c-6d32-44f9-9a3e-c581a487bc05 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-74d4c65b-e71a-42a4-83d1-6cde3e00adc5" released by "_delete_snapshot" :: held 1.801s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:59 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2c55521c-6d32-44f9-9a3e-c581a487bc05 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-3366c8c4-3e24-432a-b328-04f665c40078" released by "delete_snapshot" :: held 1.831s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:59 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-2c55521c-6d32-44f9-9a3e-c581a487bc05 tempest-ProjectMemberTests-1445315730 None] Created reservations ['f22e2bc2-9827-4b17-a8cb-9af0400827d9', 'c19b5554-9836-4546-a7bf-b334dcf231b7', '1068472d-272d-4564-acab-75876a303483', 'fe064f80-2551-4b07-911f-f3a9ca6cab23'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:32:59 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-2c55521c-6d32-44f9-9a3e-c581a487bc05 tempest-ProjectMemberTests-1445315730 None] Delete snapshot completed successfully. Sep 09 18:32:59 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2c55521c-6d32-44f9-9a3e-c581a487bc05 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-74d4c65b-e71a-42a4-83d1-6cde3e00adc5-delete_snapshot" released by "delete_snapshot" :: held 2.022s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:32:59 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1c8ebfc9-dac3-4802-8c17-061fc93e8c74 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-3366c8c4-3e24-432a-b328-04f665c40078-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:59 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1c8ebfc9-dac3-4802-8c17-061fc93e8c74 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-3366c8c4-3e24-432a-b328-04f665c40078-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:59 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1c8ebfc9-dac3-4802-8c17-061fc93e8c74 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-3366c8c4-3e24-432a-b328-04f665c40078" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:32:59 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1c8ebfc9-dac3-4802-8c17-061fc93e8c74 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-3366c8c4-3e24-432a-b328-04f665c40078" acquired by "delete_volume" :: waited 0.025s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:32:59 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d90072e-8eb6-4dda-b790-fd640455b914]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:32:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1c8ebfc9-dac3-4802-8c17-061fc93e8c74 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:32:59 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078 Sep 09 18:32:59 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:00 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1c8ebfc9-dac3-4802-8c17-061fc93e8c74 tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078" returned: 0 in 0.444s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1c8ebfc9-dac3-4802-8c17-061fc93e8c74 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:00 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078 Sep 09 18:33:00 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:00 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1c8ebfc9-dac3-4802-8c17-061fc93e8c74 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3366c8c4-3e24-432a-b328-04f665c40078" returned: 0 in 0.335s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:00 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1c8ebfc9-dac3-4802-8c17-061fc93e8c74 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-3366c8c4-3e24-432a-b328-04f665c40078" released by "delete_volume" :: held 0.860s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:00 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-1c8ebfc9-dac3-4802-8c17-061fc93e8c74 tempest-ProjectMemberTests-1445315730 None] Created reservations ['484135b6-9565-46aa-aeb0-60a7d59d294c', 'ddf2355b-c75a-4769-8658-76583e05d337', '3876acaf-2ff0-47f4-b924-17985180d9bc', '1abae8b9-1096-4544-b6c8-4e8ae253ae2e'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1c8ebfc9-dac3-4802-8c17-061fc93e8c74 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1c8ebfc9-dac3-4802-8c17-061fc93e8c74 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:00 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1c8ebfc9-dac3-4802-8c17-061fc93e8c74 tempest-ProjectMemberTests-1445315730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:00 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-1c8ebfc9-dac3-4802-8c17-061fc93e8c74 tempest-ProjectMemberTests-1445315730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1c8ebfc9-dac3-4802-8c17-061fc93e8c74 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1c8ebfc9-dac3-4802-8c17-061fc93e8c74 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:00 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:33:00 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:01 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1c8ebfc9-dac3-4802-8c17-061fc93e8c74 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.578s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-1c8ebfc9-dac3-4802-8c17-061fc93e8c74 tempest-ProjectMemberTests-1445315730 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:33:01 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-1c8ebfc9-dac3-4802-8c17-061fc93e8c74 tempest-ProjectMemberTests-1445315730 None] Deleted volume successfully. Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-1c8ebfc9-dac3-4802-8c17-061fc93e8c74 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-3366c8c4-3e24-432a-b328-04f665c40078-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Flow 'volume_create_manager' (98a01f25-f03e-4533-a36b-a2e298cbec68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8253b571-b580-4603-8377-dc36e1879c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8253b571-b580-4603-8377-dc36e1879c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1645070620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12495823-3041-4940-82da-462cf9d4511e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16d9e4115144c68db4659423a5963a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:01Z,use_quota=True,user_id='b4c31a80b5c54f3eb121e7c39fe61f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08517854-4d68-4e7c-a571-a605e1cb48ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08517854-4d68-4e7c-a571-a605e1cb48ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b614f16-8850-4fb4-9c68-7698e345c0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b614f16-8850-4fb4-9c68-7698e345c0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12495823-3041-4940-82da-462cf9d4511e', 'volume_name': 'volume-12495823-3041-4940-82da-462cf9d4511e', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e19bc21-683e-4a2b-be97-b86cc36b0dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e19bc21-683e-4a2b-be97-b86cc36b0dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0637c7-a37d-4c56-b302-8a8eeffd7f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:01 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Volume 12495823-3041-4940-82da-462cf9d4511e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12495823-3041-4940-82da-462cf9d4511e', 'volume_size': 1} Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1645070620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12495823-3041-4940-82da-462cf9d4511e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16d9e4115144c68db4659423a5963a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:01Z,use_quota=True,user_id='b4c31a80b5c54f3eb121e7c39fe61f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Creating volume 12495823-3041-4940-82da-462cf9d4511e {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:33:01 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:33:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:01 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e 1073741824 Sep 09 18:33:01 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:02 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e 1073741824" returned: 0 in 0.517s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:02 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e Sep 09 18:33:02 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Flow 'volume_create_manager' (416bc556-1e8c-4a01-b7aa-5b2e97e4b40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb77a45-b618-4c1c-a9a1-5806177ddf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb77a45-b618-4c1c-a9a1-5806177ddf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-246618592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc145cb-0e91-4795-8544-9d84231c18f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ab920e5a9f469a8c26769d0523cc9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:02Z,use_quota=True,user_id='48dbe23de3854919adfc1d1a7be06e49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d2c696f-6507-463b-b145-2af0c18ca398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d2c696f-6507-463b-b145-2af0c18ca398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45584c65-f271-4884-97ae-c11fccbb60c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45584c65-f271-4884-97ae-c11fccbb60c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cc145cb-0e91-4795-8544-9d84231c18f2', 'volume_name': 'volume-3cc145cb-0e91-4795-8544-9d84231c18f2', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f20199-cdf1-44c0-80da-58828e493b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f20199-cdf1-44c0-80da-58828e493b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:02 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa31773d-8be4-4c8f-ab07-021b5f4bab80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:02 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Volume 3cc145cb-0e91-4795-8544-9d84231c18f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cc145cb-0e91-4795-8544-9d84231c18f2', 'volume_size': 1} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e" returned: 0 in 0.311s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-246618592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc145cb-0e91-4795-8544-9d84231c18f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ab920e5a9f469a8c26769d0523cc9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:02Z,use_quota=True,user_id='48dbe23de3854919adfc1d1a7be06e49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Creating volume 3cc145cb-0e91-4795-8544-9d84231c18f2 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:33:02 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0637c7-a37d-4c56-b302-8a8eeffd7f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12495823-3041-4940-82da-462cf9d4511e', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:02 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2 1073741824 Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc2a8a1-42db-4634-856f-5c47c67ec5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:02 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:02 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Volume volume-12495823-3041-4940-82da-462cf9d4511e (12495823-3041-4940-82da-462cf9d4511e): created successfully Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fc2a8a1-42db-4634-856f-5c47c67ec5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:02 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Flow 'volume_create_manager' (98a01f25-f03e-4533-a36b-a2e298cbec68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:02 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-875595ff-416f-4051-8391-84aef24e0309 tempest-ProjectMemberTests-1445315730 None] Created volume successfully. Sep 09 18:33:03 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2 1073741824" returned: 0 in 0.454s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:03 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2 Sep 09 18:33:03 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:03 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2" returned: 0 in 0.264s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:33:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa31773d-8be4-4c8f-ab07-021b5f4bab80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cc145cb-0e91-4795-8544-9d84231c18f2', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c6998f5-11a5-4828-9172-a174ebb8c00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:03 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Volume volume-3cc145cb-0e91-4795-8544-9d84231c18f2 (3cc145cb-0e91-4795-8544-9d84231c18f2): created successfully Sep 09 18:33:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c6998f5-11a5-4828-9172-a174ebb8c00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:03 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Flow 'volume_create_manager' (416bc556-1e8c-4a01-b7aa-5b2e97e4b40f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:03 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-6fc80388-9eaf-4af9-9b9f-f2557da6a21c tempest-SnapshotDependencyTests-658588085 None] Created volume successfully. Sep 09 18:33:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3dde3792-46d8-4b26-83a3-ba511d5a43c2 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3dde3792-46d8-4b26-83a3-ba511d5a43c2 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:03 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-3dde3792-46d8-4b26-83a3-ba511d5a43c2 tempest-ProjectMemberTests-1445315730 None] Creating offline snapshot 98f77632-92d4-4b28-9612-dede811f5427 of volume 12495823-3041-4940-82da-462cf9d4511e {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:33:03 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8239ae94-f9c7-469a-9fbb-7ac1aaeac471]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3dde3792-46d8-4b26-83a3-ba511d5a43c2 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:03 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e Sep 09 18:33:03 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:04 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3dde3792-46d8-4b26-83a3-ba511d5a43c2 tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e" returned: 0 in 0.378s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3dde3792-46d8-4b26-83a3-ba511d5a43c2 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.98f77632-92d4-4b28-9612-dede811f5427 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:04 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.98f77632-92d4-4b28-9612-dede811f5427 1G Sep 09 18:33:04 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:04 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3dde3792-46d8-4b26-83a3-ba511d5a43c2 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.98f77632-92d4-4b28-9612-dede811f5427 1G" returned: 0 in 0.475s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3dde3792-46d8-4b26-83a3-ba511d5a43c2 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12495823-3041-4940-82da-462cf9d4511e -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.98f77632-92d4-4b28-9612-dede811f5427 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:04 devstack sudo[108260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12495823-3041-4940-82da-462cf9d4511e -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.98f77632-92d4-4b28-9612-dede811f5427 Sep 09 18:33:04 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3ce3bcc4-28a0-4087-adc0-5b2588074159 tempest-SnapshotDependencyTests-658588085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:05 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3dde3792-46d8-4b26-83a3-ba511d5a43c2 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12495823-3041-4940-82da-462cf9d4511e -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.98f77632-92d4-4b28-9612-dede811f5427" returned: 0 in 0.327s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:05 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-3dde3792-46d8-4b26-83a3-ba511d5a43c2 tempest-ProjectMemberTests-1445315730 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.98f77632-92d4-4b28-9612-dede811f5427 is being set with open permissions: ugo+rw Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3dde3792-46d8-4b26-83a3-ba511d5a43c2 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.98f77632-92d4-4b28-9612-dede811f5427 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:05 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.98f77632-92d4-4b28-9612-dede811f5427 Sep 09 18:33:05 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:05 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3dde3792-46d8-4b26-83a3-ba511d5a43c2 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.98f77632-92d4-4b28-9612-dede811f5427" returned: 0 in 0.251s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3dde3792-46d8-4b26-83a3-ba511d5a43c2 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:05 devstack sudo[108268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.info Sep 09 18:33:05 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Flow 'volume_create_manager' (17c966b1-7197-4db6-93f4-57fa5aa60c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9dad530-33f4-4c96-8443-f9ea94dbd7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9dad530-33f4-4c96-8443-f9ea94dbd7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-720277373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c8bcce-1649-421f-88ed-becabea6d1c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4e18d007b14019a7b42dce4232e50f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:05Z,use_quota=True,user_id='df73eac20f1e49dc9bbdd2f7224b6fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bcd7b4f-4836-46f8-bf00-3e0e1d38d86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bcd7b4f-4836-46f8-bf00-3e0e1d38d86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0da96ff-9f30-4ca0-9596-927d1e589dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0da96ff-9f30-4ca0-9596-927d1e589dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80c8bcce-1649-421f-88ed-becabea6d1c3', 'volume_name': 'volume-80c8bcce-1649-421f-88ed-becabea6d1c3', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805314c8-1947-42da-8048-7012772e8750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (805314c8-1947-42da-8048-7012772e8750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c68f6cb-45c3-49e8-9808-a45dc866009b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:05 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Volume 80c8bcce-1649-421f-88ed-becabea6d1c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80c8bcce-1649-421f-88ed-becabea6d1c3', 'volume_size': 1} Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:05 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3dde3792-46d8-4b26-83a3-ba511d5a43c2 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.info" returned: 0 in 0.267s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:05 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-3dde3792-46d8-4b26-83a3-ba511d5a43c2 tempest-ProjectMemberTests-1445315730 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.info is being set with open permissions: ugo+rw Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3dde3792-46d8-4b26-83a3-ba511d5a43c2 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:05 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.info Sep 09 18:33:05 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:05 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3dde3792-46d8-4b26-83a3-ba511d5a43c2 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.info" returned: 0 in 0.252s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3dde3792-46d8-4b26-83a3-ba511d5a43c2 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.046s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3ce3bcc4-28a0-4087-adc0-5b2588074159 tempest-SnapshotDependencyTests-658588085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.076s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-3ce3bcc4-28a0-4087-adc0-5b2588074159 tempest-SnapshotDependencyTests-658588085 None] Creating offline snapshot cd394fb9-cfc5-4db7-9db1-ace910d79d1f of volume 3cc145cb-0e91-4795-8544-9d84231c18f2 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:33:05 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-3dde3792-46d8-4b26-83a3-ba511d5a43c2 tempest-ProjectMemberTests-1445315730 None] Create snapshot completed successfully Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac66b49-f681-4d47-a626-6317cb8ec498]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3ce3bcc4-28a0-4087-adc0-5b2588074159 tempest-SnapshotDependencyTests-658588085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:06 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2 Sep 09 18:33:06 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:06 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3ce3bcc4-28a0-4087-adc0-5b2588074159 tempest-SnapshotDependencyTests-658588085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2" returned: 0 in 0.345s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3ce3bcc4-28a0-4087-adc0-5b2588074159 tempest-SnapshotDependencyTests-658588085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:06 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f 1G Sep 09 18:33:06 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:06 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3ce3bcc4-28a0-4087-adc0-5b2588074159 tempest-SnapshotDependencyTests-658588085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f 1G" returned: 0 in 0.383s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3ce3bcc4-28a0-4087-adc0-5b2588074159 tempest-SnapshotDependencyTests-658588085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cc145cb-0e91-4795-8544-9d84231c18f2 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:06 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cc145cb-0e91-4795-8544-9d84231c18f2 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f Sep 09 18:33:06 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:06 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3ce3bcc4-28a0-4087-adc0-5b2588074159 tempest-SnapshotDependencyTests-658588085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cc145cb-0e91-4795-8544-9d84231c18f2 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f" returned: 0 in 0.292s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:06 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-3ce3bcc4-28a0-4087-adc0-5b2588074159 tempest-SnapshotDependencyTests-658588085 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f is being set with open permissions: ugo+rw Sep 09 18:33:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3ce3bcc4-28a0-4087-adc0-5b2588074159 tempest-SnapshotDependencyTests-658588085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:06 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9c680fc1-c521-4418-9d4d-27a4e3389e78 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-98f77632-92d4-4b28-9612-dede811f5427-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:06 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f Sep 09 18:33:06 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:06 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9c680fc1-c521-4418-9d4d-27a4e3389e78 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-98f77632-92d4-4b28-9612-dede811f5427-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:06 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9c680fc1-c521-4418-9d4d-27a4e3389e78 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-12495823-3041-4940-82da-462cf9d4511e" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9c680fc1-c521-4418-9d4d-27a4e3389e78 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-12495823-3041-4940-82da-462cf9d4511e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9c680fc1-c521-4418-9d4d-27a4e3389e78 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-98f77632-92d4-4b28-9612-dede811f5427" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9c680fc1-c521-4418-9d4d-27a4e3389e78 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-98f77632-92d4-4b28-9612-dede811f5427" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-9c680fc1-c521-4418-9d4d-27a4e3389e78 tempest-ProjectMemberTests-1445315730 None] Deleting offline snapshot 98f77632-92d4-4b28-9612-dede811f5427 of volume 12495823-3041-4940-82da-462cf9d4511e {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-9c680fc1-c521-4418-9d4d-27a4e3389e78 tempest-ProjectMemberTests-1445315730 None] snapshot_file for this snap is: volume-12495823-3041-4940-82da-462cf9d4511e.98f77632-92d4-4b28-9612-dede811f5427 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[271477e6-bee2-477f-a1cd-6bc0f8244b2e]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9c680fc1-c521-4418-9d4d-27a4e3389e78 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.98f77632-92d4-4b28-9612-dede811f5427 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:07 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.98f77632-92d4-4b28-9612-dede811f5427 Sep 09 18:33:07 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:07 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3ce3bcc4-28a0-4087-adc0-5b2588074159 tempest-SnapshotDependencyTests-658588085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f" returned: 0 in 0.261s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3ce3bcc4-28a0-4087-adc0-5b2588074159 tempest-SnapshotDependencyTests-658588085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:07 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.info Sep 09 18:33:07 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:07 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9c680fc1-c521-4418-9d4d-27a4e3389e78 tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.98f77632-92d4-4b28-9612-dede811f5427" returned: 0 in 0.362s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-9c680fc1-c521-4418-9d4d-27a4e3389e78 tempest-ProjectMemberTests-1445315730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12495823-3041-4940-82da-462cf9d4511e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22811f1-0f91-4b64-84db-1f341594bae9]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9c680fc1-c521-4418-9d4d-27a4e3389e78 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:07 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3ce3bcc4-28a0-4087-adc0-5b2588074159 tempest-SnapshotDependencyTests-658588085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.info" returned: 0 in 0.277s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:07 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-3ce3bcc4-28a0-4087-adc0-5b2588074159 tempest-SnapshotDependencyTests-658588085 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.info is being set with open permissions: ugo+rw Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3ce3bcc4-28a0-4087-adc0-5b2588074159 tempest-SnapshotDependencyTests-658588085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:07 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.info Sep 09 18:33:07 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:07 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e Sep 09 18:33:07 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:07 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-3ce3bcc4-28a0-4087-adc0-5b2588074159 tempest-SnapshotDependencyTests-658588085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.info" returned: 0 in 0.244s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-3ce3bcc4-28a0-4087-adc0-5b2588074159 tempest-SnapshotDependencyTests-658588085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.891s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.201s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-720277373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80c8bcce-1649-421f-88ed-becabea6d1c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4e18d007b14019a7b42dce4232e50f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:05Z,use_quota=True,user_id='df73eac20f1e49dc9bbdd2f7224b6fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Creating volume 80c8bcce-1649-421f-88ed-becabea6d1c3 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:33:07 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:07 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3 1073741824 Sep 09 18:33:07 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:07 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:07 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-3ce3bcc4-28a0-4087-adc0-5b2588074159 tempest-SnapshotDependencyTests-658588085 None] Create snapshot completed successfully Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9c680fc1-c521-4418-9d4d-27a4e3389e78 tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e" returned: 0 in 0.377s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9c680fc1-c521-4418-9d4d-27a4e3389e78 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.98f77632-92d4-4b28-9612-dede811f5427 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:07 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.98f77632-92d4-4b28-9612-dede811f5427 Sep 09 18:33:07 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:08 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9c680fc1-c521-4418-9d4d-27a4e3389e78 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.98f77632-92d4-4b28-9612-dede811f5427" returned: 0 in 0.400s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9c680fc1-c521-4418-9d4d-27a4e3389e78 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.98f77632-92d4-4b28-9612-dede811f5427 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:08 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.98f77632-92d4-4b28-9612-dede811f5427 Sep 09 18:33:08 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:08 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3 1073741824" returned: 0 in 0.494s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:08 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3 Sep 09 18:33:08 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:08 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-9c680fc1-c521-4418-9d4d-27a4e3389e78 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e.98f77632-92d4-4b28-9612-dede811f5427" returned: 0 in 0.388s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:33:08 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3" returned: 0 in 0.323s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Flow 'volume_create_manager' (0e3f7cfc-d335-4227-88b6-fd9ed2b8a6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702b1a8b-a489-47bf-ad21-27e73d7a19fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c68f6cb-45c3-49e8-9808-a45dc866009b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80c8bcce-1649-421f-88ed-becabea6d1c3', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c00bb7-fe57-4d59-a446-0d6bb7f4aecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9c680fc1-c521-4418-9d4d-27a4e3389e78 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-98f77632-92d4-4b28-9612-dede811f5427" released by "_delete_snapshot" :: held 1.700s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702b1a8b-a489-47bf-ad21-27e73d7a19fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00ab920e5a9f469a8c26769d0523cc9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cd394fb9-cfc5-4db7-9db1-ace910d79d1f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:09Z,use_quota=True,user_id='48dbe23de3854919adfc1d1a7be06e49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4b4d42-ad5b-4b45-9ee8-3558fd7414c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4b4d42-ad5b-4b45-9ee8-3558fd7414c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eaa4238-7d94-469e-87c5-8c2a7cd4e008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eaa4238-7d94-469e-87c5-8c2a7cd4e008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5', 'volume_name': 'volume-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5', 'volume_size': 1, 'snapshot_id': 'cd394fb9-cfc5-4db7-9db1-ace910d79d1f'}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f16b93-d715-41eb-9143-ad3af1e19366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f16b93-d715-41eb-9143-ad3af1e19366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b37830-3a5e-46a2-a695-8c7094bcb81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:08 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Volume d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5', 'volume_size': 1, 'snapshot_id': 'cd394fb9-cfc5-4db7-9db1-ace910d79d1f'} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9c680fc1-c521-4418-9d4d-27a4e3389e78 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-12495823-3041-4940-82da-462cf9d4511e" released by "delete_snapshot" :: held 1.770s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:08 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Volume volume-80c8bcce-1649-421f-88ed-becabea6d1c3 (80c8bcce-1649-421f-88ed-becabea6d1c3): created successfully Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c00bb7-fe57-4d59-a446-0d6bb7f4aecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Flow 'volume_create_manager' (17c966b1-7197-4db6-93f4-57fa5aa60c6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Acquiring lock "cinder-quobyte-cd394fb9-cfc5-4db7-9db1-ace910d79d1f-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5" by "_create_volume_from_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:08 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-0fa6fa9c-d96d-47b0-8f0d-75975c60e60b tempest-ProjectReaderTests-1853603710 None] Created volume successfully. Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Lock "cinder-quobyte-cd394fb9-cfc5-4db7-9db1-ace910d79d1f-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Creating volume d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5 from snapshot cd394fb9-cfc5-4db7-9db1-ace910d79d1f {{(pid=87639) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Acquiring lock "cinder-quobyte-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5" by "_copy_volume_from_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Lock "cinder-quobyte-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] snapshot: cd394fb9-cfc5-4db7-9db1-ace910d79d1f, volume: d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5, {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-9c680fc1-c521-4418-9d4d-27a4e3389e78 tempest-ProjectMemberTests-1445315730 None] Created reservations ['fd9c9f1a-946e-49e3-9d5d-71d75b0a4ea9', '7f5ac3bd-063e-4d6b-af6a-e482deec8f83', '4578992f-91f8-49b8-88e5-a715a09f9e49', '479f76ba-d725-4a5b-a131-097058a66342'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dba082b-0c4e-40a5-bd89-853887316a72]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:08 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-9c680fc1-c521-4418-9d4d-27a4e3389e78 tempest-ProjectMemberTests-1445315730 None] Delete snapshot completed successfully. Sep 09 18:33:08 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-9c680fc1-c521-4418-9d4d-27a4e3389e78 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-98f77632-92d4-4b28-9612-dede811f5427-delete_snapshot" released by "delete_snapshot" :: held 2.005s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:09 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f Sep 09 18:33:09 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a60f0f29-5382-4db2-940f-aa50403d4177 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-12495823-3041-4940-82da-462cf9d4511e-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a60f0f29-5382-4db2-940f-aa50403d4177 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-12495823-3041-4940-82da-462cf9d4511e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a60f0f29-5382-4db2-940f-aa50403d4177 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-12495823-3041-4940-82da-462cf9d4511e" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a60f0f29-5382-4db2-940f-aa50403d4177 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-12495823-3041-4940-82da-462cf9d4511e" acquired by "delete_volume" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:09 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f" returned: 0 in 0.395s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cc145cb-0e91-4795-8544-9d84231c18f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:33:09 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c29d45-ec8c-4672-9a44-fee437d89509]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a60f0f29-5382-4db2-940f-aa50403d4177 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:09 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e36a053-2bcb-4692-8a55-bdeb88a67d21]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:09 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e Sep 09 18:33:09 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:09 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2 Sep 09 18:33:09 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:09 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2" returned: 0 in 0.377s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2 {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 18:33:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Creating direct copy from snapshot {{(pid=87639) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 18:33:09 devstack cinder-volume[87639]: DEBUG cinder.utils [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Path /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5 not found in is_blk_device check {{(pid=87639) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 18:33:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:09 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a60f0f29-5382-4db2-940f-aa50403d4177 tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e" returned: 0 in 0.417s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a60f0f29-5382-4db2-940f-aa50403d4177 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:09 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5 Sep 09 18:33:09 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:09 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e Sep 09 18:33:09 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-91e7d221-f0fb-4f22-aae5-065f0a4c9bfb tempest-ProjectReaderTests-1853603710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:10 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a60f0f29-5382-4db2-940f-aa50403d4177 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-12495823-3041-4940-82da-462cf9d4511e" returned: 0 in 0.292s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:10 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a60f0f29-5382-4db2-940f-aa50403d4177 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-12495823-3041-4940-82da-462cf9d4511e" released by "delete_volume" :: held 0.775s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:10 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-a60f0f29-5382-4db2-940f-aa50403d4177 tempest-ProjectMemberTests-1445315730 None] Created reservations ['8f9ce406-9e4a-4d71-8aea-b218f57d061f', '3e851a52-d93c-4305-be10-07d61accf370', '49552d3b-50cb-4750-bbff-3512358e1dc6', '81134f24-1a0f-4e42-a6af-698be2025129'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a60f0f29-5382-4db2-940f-aa50403d4177 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a60f0f29-5382-4db2-940f-aa50403d4177 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a60f0f29-5382-4db2-940f-aa50403d4177 tempest-ProjectMemberTests-1445315730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a60f0f29-5382-4db2-940f-aa50403d4177 tempest-ProjectMemberTests-1445315730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a60f0f29-5382-4db2-940f-aa50403d4177 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a60f0f29-5382-4db2-940f-aa50403d4177 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:10 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:33:10 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:10 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a60f0f29-5382-4db2-940f-aa50403d4177 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.428s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:10 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-a60f0f29-5382-4db2-940f-aa50403d4177 tempest-ProjectMemberTests-1445315730 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:33:10 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-a60f0f29-5382-4db2-940f-aa50403d4177 tempest-ProjectMemberTests-1445315730 None] Deleted volume successfully. Sep 09 18:33:10 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a60f0f29-5382-4db2-940f-aa50403d4177 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-12495823-3041-4940-82da-462cf9d4511e-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:11 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:33:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Flow 'volume_create_manager' (7ebb2a43-d3f0-4bb5-8972-28a23654ffb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42881672-c907-48a5-b755-95880a824fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42881672-c907-48a5-b755-95880a824fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-855948676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1053eab-3100-4742-ba4f-5548489bb317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16d9e4115144c68db4659423a5963a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:11Z,use_quota=True,user_id='b4c31a80b5c54f3eb121e7c39fe61f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcebb05e-d8ec-41be-988e-e9cb28e8c442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcebb05e-d8ec-41be-988e-e9cb28e8c442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918d92c9-3983-4762-8183-8adb00117bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918d92c9-3983-4762-8183-8adb00117bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1053eab-3100-4742-ba4f-5548489bb317', 'volume_name': 'volume-f1053eab-3100-4742-ba4f-5548489bb317', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f40210d-26a7-4dec-bd40-3dcf456f0c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f40210d-26a7-4dec-bd40-3dcf456f0c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:11 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1eede3-e31d-4b5b-88f5-7cab061da604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:11 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Volume f1053eab-3100-4742-ba4f-5548489bb317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1053eab-3100-4742-ba4f-5548489bb317', 'volume_size': 1} Sep 09 18:33:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:14 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5" returned: 0 in 4.674s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:14 devstack cinder-volume[87639]: DEBUG cinder.image.image_utils [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Image conversion details: src /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2, size 1024.00 MB, duration 4.67 sec, destination /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5 {{(pid=87639) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 18:33:14 devstack cinder-volume[87639]: INFO cinder.image.image_utils [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Converted 1024.00 MB image at 219.04 MB/s Sep 09 18:33:14 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5 is being set with open permissions: ugo+rw Sep 09 18:33:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:14 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5 Sep 09 18:33:14 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:14 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5" returned: 0 in 0.247s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:14 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Lock "cinder-quobyte-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5" released by "_copy_volume_from_snapshot" :: held 5.793s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:14 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Lock "cinder-quobyte-cd394fb9-cfc5-4db7-9db1-ace910d79d1f-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5" released by "_create_volume_from_snapshot" :: held 5.862s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.888s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-91e7d221-f0fb-4f22-aae5-065f0a4c9bfb tempest-ProjectReaderTests-1853603710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.750s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:14 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-91e7d221-f0fb-4f22-aae5-065f0a4c9bfb tempest-ProjectReaderTests-1853603710 None] Creating offline snapshot ec2acda3-9592-4c2e-9365-b3f6070772e0 of volume 80c8bcce-1649-421f-88ed-becabea6d1c3 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:33:14 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b37830-3a5e-46a2-a695-8c7094bcb81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5', 'volume_size': 1, 'snapshot_id': 'cd394fb9-cfc5-4db7-9db1-ace910d79d1f'}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:14 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec8fbd44-e96e-416b-ba7a-4ef9f4c2092f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:14 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a5fb86-8831-47d3-814f-52294dbc636a]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:14 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91e7d221-f0fb-4f22-aae5-065f0a4c9bfb tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:14 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Volume volume-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5 (d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5): created successfully Sep 09 18:33:14 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec8fbd44-e96e-416b-ba7a-4ef9f4c2092f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:14 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Flow 'volume_create_manager' (0e3f7cfc-d335-4227-88b6-fd9ed2b8a6ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:14 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-b8d24eb5-7781-4780-a02b-b103d4793f35 tempest-SnapshotDependencyTests-658588085 None] Created volume successfully. Sep 09 18:33:14 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3 Sep 09 18:33:14 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:15 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91e7d221-f0fb-4f22-aae5-065f0a4c9bfb tempest-ProjectReaderTests-1853603710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3" returned: 0 in 0.363s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91e7d221-f0fb-4f22-aae5-065f0a4c9bfb tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.ec2acda3-9592-4c2e-9365-b3f6070772e0 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:15 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.ec2acda3-9592-4c2e-9365-b3f6070772e0 1G Sep 09 18:33:15 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a731036e-310c-4ad6-a193-4ac585e9a273 tempest-SnapshotDependencyTests-658588085 None] Acquiring lock "cinder-cd394fb9-cfc5-4db7-9db1-ace910d79d1f-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a731036e-310c-4ad6-a193-4ac585e9a273 tempest-SnapshotDependencyTests-658588085 None] Lock "cinder-cd394fb9-cfc5-4db7-9db1-ace910d79d1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a731036e-310c-4ad6-a193-4ac585e9a273 tempest-SnapshotDependencyTests-658588085 None] Acquiring lock "cinder-quobyte-3cc145cb-0e91-4795-8544-9d84231c18f2" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a731036e-310c-4ad6-a193-4ac585e9a273 tempest-SnapshotDependencyTests-658588085 None] Lock "cinder-quobyte-3cc145cb-0e91-4795-8544-9d84231c18f2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a731036e-310c-4ad6-a193-4ac585e9a273 tempest-SnapshotDependencyTests-658588085 None] Acquiring lock "cinder-quobyte-cd394fb9-cfc5-4db7-9db1-ace910d79d1f" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:15 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a731036e-310c-4ad6-a193-4ac585e9a273 tempest-SnapshotDependencyTests-658588085 None] Lock "cinder-quobyte-cd394fb9-cfc5-4db7-9db1-ace910d79d1f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:15 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-a731036e-310c-4ad6-a193-4ac585e9a273 tempest-SnapshotDependencyTests-658588085 None] Deleting offline snapshot cd394fb9-cfc5-4db7-9db1-ace910d79d1f of volume 3cc145cb-0e91-4795-8544-9d84231c18f2 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:33:15 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-a731036e-310c-4ad6-a193-4ac585e9a273 tempest-SnapshotDependencyTests-658588085 None] snapshot_file for this snap is: volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:33:15 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[128a9c96-02f2-484d-a823-dc6f06338400]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a731036e-310c-4ad6-a193-4ac585e9a273 tempest-SnapshotDependencyTests-658588085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:15 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f Sep 09 18:33:15 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:15 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91e7d221-f0fb-4f22-aae5-065f0a4c9bfb tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.ec2acda3-9592-4c2e-9365-b3f6070772e0 1G" returned: 0 in 0.409s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91e7d221-f0fb-4f22-aae5-065f0a4c9bfb tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80c8bcce-1649-421f-88ed-becabea6d1c3 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.ec2acda3-9592-4c2e-9365-b3f6070772e0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:15 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80c8bcce-1649-421f-88ed-becabea6d1c3 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.ec2acda3-9592-4c2e-9365-b3f6070772e0 Sep 09 18:33:15 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:15 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a731036e-310c-4ad6-a193-4ac585e9a273 tempest-SnapshotDependencyTests-658588085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f" returned: 0 in 0.390s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:15 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-a731036e-310c-4ad6-a193-4ac585e9a273 tempest-SnapshotDependencyTests-658588085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cc145cb-0e91-4795-8544-9d84231c18f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:33:15 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[da222c30-a6c5-4481-b613-b3a8eca78352]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a731036e-310c-4ad6-a193-4ac585e9a273 tempest-SnapshotDependencyTests-658588085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:15 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91e7d221-f0fb-4f22-aae5-065f0a4c9bfb tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80c8bcce-1649-421f-88ed-becabea6d1c3 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.ec2acda3-9592-4c2e-9365-b3f6070772e0" returned: 0 in 0.312s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:15 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-91e7d221-f0fb-4f22-aae5-065f0a4c9bfb tempest-ProjectReaderTests-1853603710 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.ec2acda3-9592-4c2e-9365-b3f6070772e0 is being set with open permissions: ugo+rw Sep 09 18:33:15 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91e7d221-f0fb-4f22-aae5-065f0a4c9bfb tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.ec2acda3-9592-4c2e-9365-b3f6070772e0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:15 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.ec2acda3-9592-4c2e-9365-b3f6070772e0 Sep 09 18:33:15 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:15 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2 Sep 09 18:33:15 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:16 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91e7d221-f0fb-4f22-aae5-065f0a4c9bfb tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.ec2acda3-9592-4c2e-9365-b3f6070772e0" returned: 0 in 0.243s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91e7d221-f0fb-4f22-aae5-065f0a4c9bfb tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:16 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.info Sep 09 18:33:16 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:16 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a731036e-310c-4ad6-a193-4ac585e9a273 tempest-SnapshotDependencyTests-658588085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2" returned: 0 in 0.533s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a731036e-310c-4ad6-a193-4ac585e9a273 tempest-SnapshotDependencyTests-658588085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:16 devstack sudo[108435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f Sep 09 18:33:16 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:16 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91e7d221-f0fb-4f22-aae5-065f0a4c9bfb tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.info" returned: 0 in 0.270s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:16 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-91e7d221-f0fb-4f22-aae5-065f0a4c9bfb tempest-ProjectReaderTests-1853603710 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.info is being set with open permissions: ugo+rw Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91e7d221-f0fb-4f22-aae5-065f0a4c9bfb tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:16 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.info Sep 09 18:33:16 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:16 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-91e7d221-f0fb-4f22-aae5-065f0a4c9bfb tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.info" returned: 0 in 0.233s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-91e7d221-f0fb-4f22-aae5-065f0a4c9bfb tempest-ProjectReaderTests-1853603710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.927s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.885s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-855948676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1053eab-3100-4742-ba4f-5548489bb317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16d9e4115144c68db4659423a5963a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:11Z,use_quota=True,user_id='b4c31a80b5c54f3eb121e7c39fe61f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Creating volume f1053eab-3100-4742-ba4f-5548489bb317 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:33:16 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:16 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a731036e-310c-4ad6-a193-4ac585e9a273 tempest-SnapshotDependencyTests-658588085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f" returned: 0 in 0.343s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a731036e-310c-4ad6-a193-4ac585e9a273 tempest-SnapshotDependencyTests-658588085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:16 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317 1073741824 Sep 09 18:33:16 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:16 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f Sep 09 18:33:16 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:16 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-91e7d221-f0fb-4f22-aae5-065f0a4c9bfb tempest-ProjectReaderTests-1853603710 None] Create snapshot completed successfully Sep 09 18:33:16 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a731036e-310c-4ad6-a193-4ac585e9a273 tempest-SnapshotDependencyTests-658588085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2.cd394fb9-cfc5-4db7-9db1-ace910d79d1f" returned: 0 in 0.276s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a731036e-310c-4ad6-a193-4ac585e9a273 tempest-SnapshotDependencyTests-658588085 None] Lock "cinder-quobyte-cd394fb9-cfc5-4db7-9db1-ace910d79d1f" released by "_delete_snapshot" :: held 1.639s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:16 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a731036e-310c-4ad6-a193-4ac585e9a273 tempest-SnapshotDependencyTests-658588085 None] Lock "cinder-quobyte-3cc145cb-0e91-4795-8544-9d84231c18f2" released by "delete_snapshot" :: held 1.663s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-a731036e-310c-4ad6-a193-4ac585e9a273 tempest-SnapshotDependencyTests-658588085 None] Created reservations ['04f65a2c-6757-4e4d-a1d1-22afdc9e3e68', 'd720cabf-4683-45f0-b072-86c710ae2169', '4a581a17-fdda-4274-9b90-db4d7ee1d519', 'c489ef7c-43f3-4247-85c8-eb68e39aa700'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:17 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317 1073741824" returned: 0 in 0.437s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:17 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-a731036e-310c-4ad6-a193-4ac585e9a273 tempest-SnapshotDependencyTests-658588085 None] Delete snapshot completed successfully. Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-a731036e-310c-4ad6-a193-4ac585e9a273 tempest-SnapshotDependencyTests-658588085 None] Lock "cinder-cd394fb9-cfc5-4db7-9db1-ace910d79d1f-delete_snapshot" released by "delete_snapshot" :: held 1.815s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:17 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317 Sep 09 18:33:17 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:17 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317" returned: 0 in 0.240s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1eede3-e31d-4b5b-88f5-7cab061da604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1053eab-3100-4742-ba4f-5548489bb317', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed647f5-b3f0-4368-a8f5-a789a8018f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:17 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Volume volume-f1053eab-3100-4742-ba4f-5548489bb317 (f1053eab-3100-4742-ba4f-5548489bb317): created successfully Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed647f5-b3f0-4368-a8f5-a789a8018f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Flow 'volume_create_manager' (7ebb2a43-d3f0-4bb5-8972-28a23654ffb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:17 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-5d2c4b0c-73d5-444b-99bf-ccd4bcc92d0b tempest-ProjectMemberTests-1445315730 None] Created volume successfully. Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f08484ea-de76-45c9-bb8a-92da7c4ed6c7 tempest-SnapshotDependencyTests-658588085 None] Acquiring lock "cinder-3cc145cb-0e91-4795-8544-9d84231c18f2-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f08484ea-de76-45c9-bb8a-92da7c4ed6c7 tempest-SnapshotDependencyTests-658588085 None] Lock "cinder-3cc145cb-0e91-4795-8544-9d84231c18f2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f08484ea-de76-45c9-bb8a-92da7c4ed6c7 tempest-SnapshotDependencyTests-658588085 None] Acquiring lock "cinder-quobyte-3cc145cb-0e91-4795-8544-9d84231c18f2" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f08484ea-de76-45c9-bb8a-92da7c4ed6c7 tempest-SnapshotDependencyTests-658588085 None] Lock "cinder-quobyte-3cc145cb-0e91-4795-8544-9d84231c18f2" acquired by "delete_volume" :: waited 0.013s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7050cdc-ede4-464f-83f9-27720a33034b]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f08484ea-de76-45c9-bb8a-92da7c4ed6c7 tempest-SnapshotDependencyTests-658588085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-36545f7b-1910-4d80-9e98-47682dc5c6cd tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-ec2acda3-9592-4c2e-9365-b3f6070772e0-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-36545f7b-1910-4d80-9e98-47682dc5c6cd tempest-ProjectReaderTests-1853603710 None] Lock "cinder-ec2acda3-9592-4c2e-9365-b3f6070772e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-36545f7b-1910-4d80-9e98-47682dc5c6cd tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-quobyte-80c8bcce-1649-421f-88ed-becabea6d1c3" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-36545f7b-1910-4d80-9e98-47682dc5c6cd tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-80c8bcce-1649-421f-88ed-becabea6d1c3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-36545f7b-1910-4d80-9e98-47682dc5c6cd tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-quobyte-ec2acda3-9592-4c2e-9365-b3f6070772e0" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-36545f7b-1910-4d80-9e98-47682dc5c6cd tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-ec2acda3-9592-4c2e-9365-b3f6070772e0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-36545f7b-1910-4d80-9e98-47682dc5c6cd tempest-ProjectReaderTests-1853603710 None] Deleting offline snapshot ec2acda3-9592-4c2e-9365-b3f6070772e0 of volume 80c8bcce-1649-421f-88ed-becabea6d1c3 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-36545f7b-1910-4d80-9e98-47682dc5c6cd tempest-ProjectReaderTests-1853603710 None] snapshot_file for this snap is: volume-80c8bcce-1649-421f-88ed-becabea6d1c3.ec2acda3-9592-4c2e-9365-b3f6070772e0 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f62d986-925c-4302-b1c8-33835f81751e]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-36545f7b-1910-4d80-9e98-47682dc5c6cd tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.ec2acda3-9592-4c2e-9365-b3f6070772e0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:17 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2 Sep 09 18:33:17 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:17 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.ec2acda3-9592-4c2e-9365-b3f6070772e0 Sep 09 18:33:17 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:17 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f08484ea-de76-45c9-bb8a-92da7c4ed6c7 tempest-SnapshotDependencyTests-658588085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2" returned: 0 in 0.408s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:17 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f08484ea-de76-45c9-bb8a-92da7c4ed6c7 tempest-SnapshotDependencyTests-658588085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:17 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2 Sep 09 18:33:17 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:18 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-36545f7b-1910-4d80-9e98-47682dc5c6cd tempest-ProjectReaderTests-1853603710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.ec2acda3-9592-4c2e-9365-b3f6070772e0" returned: 0 in 0.388s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-36545f7b-1910-4d80-9e98-47682dc5c6cd tempest-ProjectReaderTests-1853603710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80c8bcce-1649-421f-88ed-becabea6d1c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[93acc5d0-5cf9-4805-adc4-ec5acebca667]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-36545f7b-1910-4d80-9e98-47682dc5c6cd tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0811de22-a900-4a0f-a906-9830c4da180c tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0811de22-a900-4a0f-a906-9830c4da180c tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-0811de22-a900-4a0f-a906-9830c4da180c tempest-ProjectMemberTests-1445315730 None] Creating offline snapshot 158f18ca-6777-486a-964f-f4e6b049164f of volume f1053eab-3100-4742-ba4f-5548489bb317 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[03942324-3299-4331-81f6-c7425fc5fc91]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0811de22-a900-4a0f-a906-9830c4da180c tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:18 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3 Sep 09 18:33:18 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:18 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f08484ea-de76-45c9-bb8a-92da7c4ed6c7 tempest-SnapshotDependencyTests-658588085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3cc145cb-0e91-4795-8544-9d84231c18f2" returned: 0 in 0.292s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f08484ea-de76-45c9-bb8a-92da7c4ed6c7 tempest-SnapshotDependencyTests-658588085 None] Lock "cinder-quobyte-3cc145cb-0e91-4795-8544-9d84231c18f2" released by "delete_volume" :: held 0.762s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:18 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317 Sep 09 18:33:18 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-f08484ea-de76-45c9-bb8a-92da7c4ed6c7 tempest-SnapshotDependencyTests-658588085 None] Created reservations ['d01e819b-792e-4ed4-939f-3daf5456ca33', 'e2668ca8-d633-4a58-a314-b681d389b995', '0476b6a9-7751-4147-b792-720a9d98dfd4', '71e3eb9c-d4b7-4f37-9054-79fa7346b2b9'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f08484ea-de76-45c9-bb8a-92da7c4ed6c7 tempest-SnapshotDependencyTests-658588085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f08484ea-de76-45c9-bb8a-92da7c4ed6c7 tempest-SnapshotDependencyTests-658588085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f08484ea-de76-45c9-bb8a-92da7c4ed6c7 tempest-SnapshotDependencyTests-658588085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-f08484ea-de76-45c9-bb8a-92da7c4ed6c7 tempest-SnapshotDependencyTests-658588085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-f08484ea-de76-45c9-bb8a-92da7c4ed6c7 tempest-SnapshotDependencyTests-658588085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f08484ea-de76-45c9-bb8a-92da7c4ed6c7 tempest-SnapshotDependencyTests-658588085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:18 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:33:18 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:18 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-36545f7b-1910-4d80-9e98-47682dc5c6cd tempest-ProjectReaderTests-1853603710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3" returned: 0 in 0.386s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-36545f7b-1910-4d80-9e98-47682dc5c6cd tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.ec2acda3-9592-4c2e-9365-b3f6070772e0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:18 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.ec2acda3-9592-4c2e-9365-b3f6070772e0 Sep 09 18:33:18 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:18 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0811de22-a900-4a0f-a906-9830c4da180c tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317" returned: 0 in 0.393s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0811de22-a900-4a0f-a906-9830c4da180c tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.158f18ca-6777-486a-964f-f4e6b049164f 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:18 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.158f18ca-6777-486a-964f-f4e6b049164f 1G Sep 09 18:33:18 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dd9bac81-8ce1-4797-8ae9-725b3ca9d591 tempest-SnapshotDependencyTests-658588085 None] Acquiring lock "cinder-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dd9bac81-8ce1-4797-8ae9-725b3ca9d591 tempest-SnapshotDependencyTests-658588085 None] Lock "cinder-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:18 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f08484ea-de76-45c9-bb8a-92da7c4ed6c7 tempest-SnapshotDependencyTests-658588085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.320s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-f08484ea-de76-45c9-bb8a-92da7c4ed6c7 tempest-SnapshotDependencyTests-658588085 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:33:18 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-f08484ea-de76-45c9-bb8a-92da7c4ed6c7 tempest-SnapshotDependencyTests-658588085 None] Deleted volume successfully. Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dd9bac81-8ce1-4797-8ae9-725b3ca9d591 tempest-SnapshotDependencyTests-658588085 None] Acquiring lock "cinder-quobyte-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f08484ea-de76-45c9-bb8a-92da7c4ed6c7 tempest-SnapshotDependencyTests-658588085 None] Lock "cinder-3cc145cb-0e91-4795-8544-9d84231c18f2-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dd9bac81-8ce1-4797-8ae9-725b3ca9d591 tempest-SnapshotDependencyTests-658588085 None] Lock "cinder-quobyte-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5" acquired by "delete_volume" :: waited 0.029s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[18680eaa-6db6-45bb-a9ec-2d785d8b5876]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dd9bac81-8ce1-4797-8ae9-725b3ca9d591 tempest-SnapshotDependencyTests-658588085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:18 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-36545f7b-1910-4d80-9e98-47682dc5c6cd tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.ec2acda3-9592-4c2e-9365-b3f6070772e0" returned: 0 in 0.415s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:18 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-36545f7b-1910-4d80-9e98-47682dc5c6cd tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.ec2acda3-9592-4c2e-9365-b3f6070772e0 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:18 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.ec2acda3-9592-4c2e-9365-b3f6070772e0 Sep 09 18:33:18 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:18 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5 Sep 09 18:33:18 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:19 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0811de22-a900-4a0f-a906-9830c4da180c tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.158f18ca-6777-486a-964f-f4e6b049164f 1G" returned: 0 in 0.464s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0811de22-a900-4a0f-a906-9830c4da180c tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1053eab-3100-4742-ba4f-5548489bb317 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.158f18ca-6777-486a-964f-f4e6b049164f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:19 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1053eab-3100-4742-ba4f-5548489bb317 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.158f18ca-6777-486a-964f-f4e6b049164f Sep 09 18:33:19 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:19 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-36545f7b-1910-4d80-9e98-47682dc5c6cd tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3.ec2acda3-9592-4c2e-9365-b3f6070772e0" returned: 0 in 0.268s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:19 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dd9bac81-8ce1-4797-8ae9-725b3ca9d591 tempest-SnapshotDependencyTests-658588085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5" returned: 0 in 0.387s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dd9bac81-8ce1-4797-8ae9-725b3ca9d591 tempest-SnapshotDependencyTests-658588085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-36545f7b-1910-4d80-9e98-47682dc5c6cd tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-ec2acda3-9592-4c2e-9365-b3f6070772e0" released by "_delete_snapshot" :: held 1.569s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-36545f7b-1910-4d80-9e98-47682dc5c6cd tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-80c8bcce-1649-421f-88ed-becabea6d1c3" released by "delete_snapshot" :: held 1.601s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:19 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5 Sep 09 18:33:19 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-36545f7b-1910-4d80-9e98-47682dc5c6cd tempest-ProjectReaderTests-1853603710 None] Created reservations ['fb93599d-4f4b-4562-89f7-2b9b2ff56feb', '9ea0a554-49bc-42d7-843d-40c6b1e34021', 'cbb57073-09d3-436b-b433-58e7b7606a9c', 'a02ebfb8-31b6-4d68-8772-ec837d206bae'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:19 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-36545f7b-1910-4d80-9e98-47682dc5c6cd tempest-ProjectReaderTests-1853603710 None] Delete snapshot completed successfully. Sep 09 18:33:19 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0811de22-a900-4a0f-a906-9830c4da180c tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1053eab-3100-4742-ba4f-5548489bb317 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.158f18ca-6777-486a-964f-f4e6b049164f" returned: 0 in 0.297s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:19 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-0811de22-a900-4a0f-a906-9830c4da180c tempest-ProjectMemberTests-1445315730 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.158f18ca-6777-486a-964f-f4e6b049164f is being set with open permissions: ugo+rw Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0811de22-a900-4a0f-a906-9830c4da180c tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.158f18ca-6777-486a-964f-f4e6b049164f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-36545f7b-1910-4d80-9e98-47682dc5c6cd tempest-ProjectReaderTests-1853603710 None] Lock "cinder-ec2acda3-9592-4c2e-9365-b3f6070772e0-delete_snapshot" released by "delete_snapshot" :: held 1.766s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:19 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.158f18ca-6777-486a-964f-f4e6b049164f Sep 09 18:33:19 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:19 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dd9bac81-8ce1-4797-8ae9-725b3ca9d591 tempest-SnapshotDependencyTests-658588085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5" returned: 0 in 0.270s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dd9bac81-8ce1-4797-8ae9-725b3ca9d591 tempest-SnapshotDependencyTests-658588085 None] Lock "cinder-quobyte-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5" released by "delete_volume" :: held 0.694s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-dd9bac81-8ce1-4797-8ae9-725b3ca9d591 tempest-SnapshotDependencyTests-658588085 None] Created reservations ['7d507f4b-659c-4dc0-ae12-ab39f5fceb42', '31c04b41-f90c-4254-9430-f6b7fa92cbab', '9aff1034-6e2e-4893-ae07-a7ae9ef836f5', '3a415f3e-c4f4-43bb-8f1b-5bd5f04eb083'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-dd9bac81-8ce1-4797-8ae9-725b3ca9d591 tempest-SnapshotDependencyTests-658588085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-dd9bac81-8ce1-4797-8ae9-725b3ca9d591 tempest-SnapshotDependencyTests-658588085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-dd9bac81-8ce1-4797-8ae9-725b3ca9d591 tempest-SnapshotDependencyTests-658588085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-dd9bac81-8ce1-4797-8ae9-725b3ca9d591 tempest-SnapshotDependencyTests-658588085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-dd9bac81-8ce1-4797-8ae9-725b3ca9d591 tempest-SnapshotDependencyTests-658588085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:19 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dd9bac81-8ce1-4797-8ae9-725b3ca9d591 tempest-SnapshotDependencyTests-658588085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0811de22-a900-4a0f-a906-9830c4da180c tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.158f18ca-6777-486a-964f-f4e6b049164f" returned: 0 in 0.257s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:19 devstack sudo[108512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:33:19 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0811de22-a900-4a0f-a906-9830c4da180c tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:19 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.info Sep 09 18:33:19 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-265b968f-1985-4d45-924f-9a4564c48335 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-80c8bcce-1649-421f-88ed-becabea6d1c3-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-265b968f-1985-4d45-924f-9a4564c48335 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-80c8bcce-1649-421f-88ed-becabea6d1c3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-265b968f-1985-4d45-924f-9a4564c48335 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-quobyte-80c8bcce-1649-421f-88ed-becabea6d1c3" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-265b968f-1985-4d45-924f-9a4564c48335 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-80c8bcce-1649-421f-88ed-becabea6d1c3" acquired by "delete_volume" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cce8b80-febd-4e5a-a5c6-c9c6bfe661bf]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-265b968f-1985-4d45-924f-9a4564c48335 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:19 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-dd9bac81-8ce1-4797-8ae9-725b3ca9d591 tempest-SnapshotDependencyTests-658588085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.326s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-dd9bac81-8ce1-4797-8ae9-725b3ca9d591 tempest-SnapshotDependencyTests-658588085 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:33:19 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-dd9bac81-8ce1-4797-8ae9-725b3ca9d591 tempest-SnapshotDependencyTests-658588085 None] Deleted volume successfully. Sep 09 18:33:19 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0811de22-a900-4a0f-a906-9830c4da180c tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.info" returned: 0 in 0.300s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:19 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-0811de22-a900-4a0f-a906-9830c4da180c tempest-ProjectMemberTests-1445315730 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.info is being set with open permissions: ugo+rw Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0811de22-a900-4a0f-a906-9830c4da180c tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:19 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.info Sep 09 18:33:19 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:19 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-dd9bac81-8ce1-4797-8ae9-725b3ca9d591 tempest-SnapshotDependencyTests-658588085 None] Lock "cinder-d4ddc9fe-a46b-4aeb-a9e1-82beb1afdcb5-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:20 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3 Sep 09 18:33:20 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:20 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0811de22-a900-4a0f-a906-9830c4da180c tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.info" returned: 0 in 0.289s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0811de22-a900-4a0f-a906-9830c4da180c tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.082s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:20 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-0811de22-a900-4a0f-a906-9830c4da180c tempest-ProjectMemberTests-1445315730 None] Create snapshot completed successfully Sep 09 18:33:20 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-265b968f-1985-4d45-924f-9a4564c48335 tempest-ProjectReaderTests-1853603710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3" returned: 0 in 0.438s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-265b968f-1985-4d45-924f-9a4564c48335 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:20 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3 Sep 09 18:33:20 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:20 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-265b968f-1985-4d45-924f-9a4564c48335 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-80c8bcce-1649-421f-88ed-becabea6d1c3" returned: 0 in 0.252s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:20 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-265b968f-1985-4d45-924f-9a4564c48335 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-80c8bcce-1649-421f-88ed-becabea6d1c3" released by "delete_volume" :: held 0.762s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:20 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-265b968f-1985-4d45-924f-9a4564c48335 tempest-ProjectReaderTests-1853603710 None] Created reservations ['6848f638-530c-4b57-a263-123a29c467b9', 'de592b1c-fd16-49b1-be6d-45c3984e6c7a', 'a1d9e602-3c35-4e9e-8d10-4ba4f66b6464', 'c9fbe75a-affd-485a-b20f-69ea15664321'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-265b968f-1985-4d45-924f-9a4564c48335 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-265b968f-1985-4d45-924f-9a4564c48335 tempest-ProjectReaderTests-1853603710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-265b968f-1985-4d45-924f-9a4564c48335 tempest-ProjectReaderTests-1853603710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:20 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-265b968f-1985-4d45-924f-9a4564c48335 tempest-ProjectReaderTests-1853603710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-265b968f-1985-4d45-924f-9a4564c48335 tempest-ProjectReaderTests-1853603710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:20 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-265b968f-1985-4d45-924f-9a4564c48335 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:20 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:33:20 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:21 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-265b968f-1985-4d45-924f-9a4564c48335 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.261s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-265b968f-1985-4d45-924f-9a4564c48335 tempest-ProjectReaderTests-1853603710 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:33:21 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-265b968f-1985-4d45-924f-9a4564c48335 tempest-ProjectReaderTests-1853603710 None] Deleted volume successfully. Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-265b968f-1985-4d45-924f-9a4564c48335 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-80c8bcce-1649-421f-88ed-becabea6d1c3-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f1de3976-f11a-4021-99e1-3c4167403267 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-158f18ca-6777-486a-964f-f4e6b049164f-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f1de3976-f11a-4021-99e1-3c4167403267 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-158f18ca-6777-486a-964f-f4e6b049164f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f1de3976-f11a-4021-99e1-3c4167403267 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-f1053eab-3100-4742-ba4f-5548489bb317" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f1de3976-f11a-4021-99e1-3c4167403267 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-f1053eab-3100-4742-ba4f-5548489bb317" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f1de3976-f11a-4021-99e1-3c4167403267 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-158f18ca-6777-486a-964f-f4e6b049164f" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f1de3976-f11a-4021-99e1-3c4167403267 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-158f18ca-6777-486a-964f-f4e6b049164f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-f1de3976-f11a-4021-99e1-3c4167403267 tempest-ProjectMemberTests-1445315730 None] Deleting offline snapshot 158f18ca-6777-486a-964f-f4e6b049164f of volume f1053eab-3100-4742-ba4f-5548489bb317 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-f1de3976-f11a-4021-99e1-3c4167403267 tempest-ProjectMemberTests-1445315730 None] snapshot_file for this snap is: volume-f1053eab-3100-4742-ba4f-5548489bb317.158f18ca-6777-486a-964f-f4e6b049164f {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4545106-c88a-46e5-b503-2d539150b067]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f1de3976-f11a-4021-99e1-3c4167403267 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.158f18ca-6777-486a-964f-f4e6b049164f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Flow 'volume_create_manager' (aa98e7e8-3dcd-4c69-9c31-c2bf9f9f81b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd63680-3f1d-48b1-a1af-00811d56ae68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd63680-3f1d-48b1-a1af-00811d56ae68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-774067070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178c0bf1-92e8-489d-ab06-0f6e9dffd589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4e18d007b14019a7b42dce4232e50f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:21Z,use_quota=True,user_id='df73eac20f1e49dc9bbdd2f7224b6fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acdc4d7a-0642-4c98-a658-9c6cdeb886ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acdc4d7a-0642-4c98-a658-9c6cdeb886ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6171e1-d644-4b98-bbd2-8057ac6b964d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6171e1-d644-4b98-bbd2-8057ac6b964d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '178c0bf1-92e8-489d-ab06-0f6e9dffd589', 'volume_name': 'volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc23a652-848e-4500-ba8e-4f9ae740b2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc23a652-848e-4500-ba8e-4f9ae740b2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824dc5c7-c83a-4c34-9e24-9bb4cb2de370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:21 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Volume 178c0bf1-92e8-489d-ab06-0f6e9dffd589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589', 'volume_size': 1} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-774067070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178c0bf1-92e8-489d-ab06-0f6e9dffd589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4e18d007b14019a7b42dce4232e50f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:21Z,use_quota=True,user_id='df73eac20f1e49dc9bbdd2f7224b6fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Creating volume 178c0bf1-92e8-489d-ab06-0f6e9dffd589 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:21 devstack sudo[108536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.158f18ca-6777-486a-964f-f4e6b049164f Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:21 devstack sudo[108536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:33:21 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:21 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589 1073741824 Sep 09 18:33:21 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:21 devstack sudo[108536]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f1de3976-f11a-4021-99e1-3c4167403267 tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.158f18ca-6777-486a-964f-f4e6b049164f" returned: 0 in 0.438s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-f1de3976-f11a-4021-99e1-3c4167403267 tempest-ProjectMemberTests-1445315730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1053eab-3100-4742-ba4f-5548489bb317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb9c00d-4cb8-494e-a5cf-c5e94c8067d4]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:21 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f1de3976-f11a-4021-99e1-3c4167403267 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:22 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317 Sep 09 18:33:22 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:22 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589 1073741824" returned: 0 in 0.466s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:22 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589 Sep 09 18:33:22 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:22 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f1de3976-f11a-4021-99e1-3c4167403267 tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317" returned: 0 in 0.398s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f1de3976-f11a-4021-99e1-3c4167403267 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.158f18ca-6777-486a-964f-f4e6b049164f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:22 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.158f18ca-6777-486a-964f-f4e6b049164f Sep 09 18:33:22 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:22 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589" returned: 0 in 0.260s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:22 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:33:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824dc5c7-c83a-4c34-9e24-9bb4cb2de370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509f7977-54ea-446a-8714-adfcb4ebf54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:22 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Volume volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589 (178c0bf1-92e8-489d-ab06-0f6e9dffd589): created successfully Sep 09 18:33:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509f7977-54ea-446a-8714-adfcb4ebf54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:22 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Flow 'volume_create_manager' (aa98e7e8-3dcd-4c69-9c31-c2bf9f9f81b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:22 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-bbe9eab2-5f83-47cd-9f91-8b768b2fffc4 tempest-ProjectReaderTests-1853603710 None] Created volume successfully. Sep 09 18:33:22 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f1de3976-f11a-4021-99e1-3c4167403267 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.158f18ca-6777-486a-964f-f4e6b049164f" returned: 0 in 0.383s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f1de3976-f11a-4021-99e1-3c4167403267 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.158f18ca-6777-486a-964f-f4e6b049164f {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:22 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.158f18ca-6777-486a-964f-f4e6b049164f Sep 09 18:33:22 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:22 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:22 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f1de3976-f11a-4021-99e1-3c4167403267 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317.158f18ca-6777-486a-964f-f4e6b049164f" returned: 0 in 0.248s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f1de3976-f11a-4021-99e1-3c4167403267 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-158f18ca-6777-486a-964f-f4e6b049164f" released by "_delete_snapshot" :: held 1.590s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f1de3976-f11a-4021-99e1-3c4167403267 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-f1053eab-3100-4742-ba4f-5548489bb317" released by "delete_snapshot" :: held 1.621s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:23 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-f1de3976-f11a-4021-99e1-3c4167403267 tempest-ProjectMemberTests-1445315730 None] Created reservations ['c6039a5e-104e-4b32-a7f6-98731f66eba2', '18bce6da-b7da-4c5a-a4ae-5a90151ebd61', 'ae5ee126-7667-49b5-9fd2-b7a98a72302c', '03b313bd-d9be-4a25-ac53-157882bc785f'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:23 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-f1de3976-f11a-4021-99e1-3c4167403267 tempest-ProjectMemberTests-1445315730 None] Delete snapshot completed successfully. Sep 09 18:33:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f1de3976-f11a-4021-99e1-3c4167403267 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-158f18ca-6777-486a-964f-f4e6b049164f-delete_snapshot" released by "delete_snapshot" :: held 1.790s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6d0d1138-de00-409d-8b00-b5529da53834 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-f1053eab-3100-4742-ba4f-5548489bb317-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6d0d1138-de00-409d-8b00-b5529da53834 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-f1053eab-3100-4742-ba4f-5548489bb317-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6d0d1138-de00-409d-8b00-b5529da53834 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-f1053eab-3100-4742-ba4f-5548489bb317" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:23 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6d0d1138-de00-409d-8b00-b5529da53834 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-f1053eab-3100-4742-ba4f-5548489bb317" acquired by "delete_volume" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:23 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc206aae-6e06-401c-9be9-fa6867accf89]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6d0d1138-de00-409d-8b00-b5529da53834 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c719deda-55d8-474d-91ce-f8bd1236e0f6 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c719deda-55d8-474d-91ce-f8bd1236e0f6 tempest-ProjectReaderTests-1853603710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:23 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-c719deda-55d8-474d-91ce-f8bd1236e0f6 tempest-ProjectReaderTests-1853603710 None] Creating offline snapshot bc43c35c-12cc-45d7-9bba-d71175ee572d of volume 178c0bf1-92e8-489d-ab06-0f6e9dffd589 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:33:23 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c068bb8d-f42b-47d3-b1d9-5eea0b07f17d]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:23 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c719deda-55d8-474d-91ce-f8bd1236e0f6 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:23 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317 Sep 09 18:33:23 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:24 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589 Sep 09 18:33:24 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:24 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6d0d1138-de00-409d-8b00-b5529da53834 tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317" returned: 0 in 0.400s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6d0d1138-de00-409d-8b00-b5529da53834 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:24 devstack sudo[108573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317 Sep 09 18:33:24 devstack sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:24 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c719deda-55d8-474d-91ce-f8bd1236e0f6 tempest-ProjectReaderTests-1853603710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589" returned: 0 in 0.375s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c719deda-55d8-474d-91ce-f8bd1236e0f6 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.bc43c35c-12cc-45d7-9bba-d71175ee572d 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:24 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.bc43c35c-12cc-45d7-9bba-d71175ee572d 1G Sep 09 18:33:24 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:24 devstack sudo[108573]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6d0d1138-de00-409d-8b00-b5529da53834 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-f1053eab-3100-4742-ba4f-5548489bb317" returned: 0 in 0.259s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:24 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6d0d1138-de00-409d-8b00-b5529da53834 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-f1053eab-3100-4742-ba4f-5548489bb317" released by "delete_volume" :: held 0.749s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:24 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-6d0d1138-de00-409d-8b00-b5529da53834 tempest-ProjectMemberTests-1445315730 None] Created reservations ['18903f69-47f6-421c-b55c-e69d87a32051', '7a6b5a9e-0f99-43a8-820c-e50b39ba6eb4', 'e4f489d1-a3af-4d5e-b007-0f18fcf4d881', '6f23bed9-433f-49e4-a6cf-0597ae2acf83'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6d0d1138-de00-409d-8b00-b5529da53834 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6d0d1138-de00-409d-8b00-b5529da53834 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6d0d1138-de00-409d-8b00-b5529da53834 tempest-ProjectMemberTests-1445315730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:24 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-6d0d1138-de00-409d-8b00-b5529da53834 tempest-ProjectMemberTests-1445315730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-6d0d1138-de00-409d-8b00-b5529da53834 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6d0d1138-de00-409d-8b00-b5529da53834 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:24 devstack sudo[108586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:33:24 devstack sudo[108586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:24 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c719deda-55d8-474d-91ce-f8bd1236e0f6 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.bc43c35c-12cc-45d7-9bba-d71175ee572d 1G" returned: 0 in 0.602s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c719deda-55d8-474d-91ce-f8bd1236e0f6 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.bc43c35c-12cc-45d7-9bba-d71175ee572d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:24 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.bc43c35c-12cc-45d7-9bba-d71175ee572d Sep 09 18:33:24 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:24 devstack sudo[108586]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:24 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-6d0d1138-de00-409d-8b00-b5529da53834 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.311s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:24 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-6d0d1138-de00-409d-8b00-b5529da53834 tempest-ProjectMemberTests-1445315730 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:33:24 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-6d0d1138-de00-409d-8b00-b5529da53834 tempest-ProjectMemberTests-1445315730 None] Deleted volume successfully. Sep 09 18:33:25 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-6d0d1138-de00-409d-8b00-b5529da53834 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-f1053eab-3100-4742-ba4f-5548489bb317-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:25 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c719deda-55d8-474d-91ce-f8bd1236e0f6 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.bc43c35c-12cc-45d7-9bba-d71175ee572d" returned: 0 in 0.356s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:25 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-c719deda-55d8-474d-91ce-f8bd1236e0f6 tempest-ProjectReaderTests-1853603710 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.bc43c35c-12cc-45d7-9bba-d71175ee572d is being set with open permissions: ugo+rw Sep 09 18:33:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c719deda-55d8-474d-91ce-f8bd1236e0f6 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.bc43c35c-12cc-45d7-9bba-d71175ee572d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:25 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.bc43c35c-12cc-45d7-9bba-d71175ee572d Sep 09 18:33:25 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:25 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:33:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Flow 'volume_create_manager' (c0389590-39c8-4852-8a18-43eb49de2cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e529b4-ccc4-4bf5-833c-8d136ec99372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1e529b4-ccc4-4bf5-833c-8d136ec99372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1368994366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d1fa30-9117-4642-9423-0d9de100a442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16d9e4115144c68db4659423a5963a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:25Z,use_quota=True,user_id='b4c31a80b5c54f3eb121e7c39fe61f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d765e201-4155-46b6-90a2-be7139b68df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d765e201-4155-46b6-90a2-be7139b68df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c7f560d-cf85-4f23-ad48-6e6bff96dcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c7f560d-cf85-4f23-ad48-6e6bff96dcb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01d1fa30-9117-4642-9423-0d9de100a442', 'volume_name': 'volume-01d1fa30-9117-4642-9423-0d9de100a442', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd785001-c6f6-4e4c-8ef7-8c40c58930ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd785001-c6f6-4e4c-8ef7-8c40c58930ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:25 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36640ae2-bd9c-4e9f-9411-781c72d6173f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:25 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Volume 01d1fa30-9117-4642-9423-0d9de100a442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01d1fa30-9117-4642-9423-0d9de100a442', 'volume_size': 1} Sep 09 18:33:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:25 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c719deda-55d8-474d-91ce-f8bd1236e0f6 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.bc43c35c-12cc-45d7-9bba-d71175ee572d" returned: 0 in 0.287s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c719deda-55d8-474d-91ce-f8bd1236e0f6 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:25 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.info Sep 09 18:33:25 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:25 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c719deda-55d8-474d-91ce-f8bd1236e0f6 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.info" returned: 0 in 0.261s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:25 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-c719deda-55d8-474d-91ce-f8bd1236e0f6 tempest-ProjectReaderTests-1853603710 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.info is being set with open permissions: ugo+rw Sep 09 18:33:25 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c719deda-55d8-474d-91ce-f8bd1236e0f6 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:25 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.info Sep 09 18:33:25 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:26 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c719deda-55d8-474d-91ce-f8bd1236e0f6 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.info" returned: 0 in 0.263s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-c719deda-55d8-474d-91ce-f8bd1236e0f6 tempest-ProjectReaderTests-1853603710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.236s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.680s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1368994366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d1fa30-9117-4642-9423-0d9de100a442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16d9e4115144c68db4659423a5963a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:25Z,use_quota=True,user_id='b4c31a80b5c54f3eb121e7c39fe61f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:33:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Creating volume 01d1fa30-9117-4642-9423-0d9de100a442 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:33:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:33:26 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:33:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:26 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442 1073741824 Sep 09 18:33:26 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:26 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-c719deda-55d8-474d-91ce-f8bd1236e0f6 tempest-ProjectReaderTests-1853603710 None] Create snapshot completed successfully Sep 09 18:33:26 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442 1073741824" returned: 0 in 0.429s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:26 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442 Sep 09 18:33:26 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:26 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442" returned: 0 in 0.244s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:26 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:33:26 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36640ae2-bd9c-4e9f-9411-781c72d6173f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01d1fa30-9117-4642-9423-0d9de100a442', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67c8add-ac13-452c-8ea3-a6667490905d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:26 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Volume volume-01d1fa30-9117-4642-9423-0d9de100a442 (01d1fa30-9117-4642-9423-0d9de100a442): created successfully Sep 09 18:33:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67c8add-ac13-452c-8ea3-a6667490905d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:26 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Flow 'volume_create_manager' (c0389590-39c8-4852-8a18-43eb49de2cc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:26 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-15f80a64-8aad-429e-87c7-e661571e1b68 tempest-ProjectMemberTests-1445315730 None] Created volume successfully. Sep 09 18:33:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7b5e3316-9245-46a2-bdbc-9837f6b70322 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-bc43c35c-12cc-45d7-9bba-d71175ee572d-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7b5e3316-9245-46a2-bdbc-9837f6b70322 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-bc43c35c-12cc-45d7-9bba-d71175ee572d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7b5e3316-9245-46a2-bdbc-9837f6b70322 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-quobyte-178c0bf1-92e8-489d-ab06-0f6e9dffd589" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7b5e3316-9245-46a2-bdbc-9837f6b70322 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-178c0bf1-92e8-489d-ab06-0f6e9dffd589" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7b5e3316-9245-46a2-bdbc-9837f6b70322 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-quobyte-bc43c35c-12cc-45d7-9bba-d71175ee572d" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:27 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7b5e3316-9245-46a2-bdbc-9837f6b70322 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-bc43c35c-12cc-45d7-9bba-d71175ee572d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:27 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-7b5e3316-9245-46a2-bdbc-9837f6b70322 tempest-ProjectReaderTests-1853603710 None] Deleting offline snapshot bc43c35c-12cc-45d7-9bba-d71175ee572d of volume 178c0bf1-92e8-489d-ab06-0f6e9dffd589 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:33:27 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-7b5e3316-9245-46a2-bdbc-9837f6b70322 tempest-ProjectReaderTests-1853603710 None] snapshot_file for this snap is: volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.bc43c35c-12cc-45d7-9bba-d71175ee572d {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:33:27 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a0ea23-6338-4762-9dd4-bf5284a3f8b2]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7b5e3316-9245-46a2-bdbc-9837f6b70322 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.bc43c35c-12cc-45d7-9bba-d71175ee572d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:27 devstack sudo[108614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.bc43c35c-12cc-45d7-9bba-d71175ee572d Sep 09 18:33:27 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:27 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7b5e3316-9245-46a2-bdbc-9837f6b70322 tempest-ProjectReaderTests-1853603710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.bc43c35c-12cc-45d7-9bba-d71175ee572d" returned: 0 in 0.408s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:27 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-7b5e3316-9245-46a2-bdbc-9837f6b70322 tempest-ProjectReaderTests-1853603710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:33:27 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e72a6bca-9187-40b2-a5b7-21ea09694202]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7b5e3316-9245-46a2-bdbc-9837f6b70322 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ed43f78d-386a-4cc8-825b-259841177201 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ed43f78d-386a-4cc8-825b-259841177201 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:27 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-ed43f78d-386a-4cc8-825b-259841177201 tempest-ProjectMemberTests-1445315730 None] Creating offline snapshot 35f52897-af33-4dc7-be60-f43e119b6acd of volume 01d1fa30-9117-4642-9423-0d9de100a442 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:33:27 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d20c41-14d5-46ac-a096-c8f2c5de1a5a]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed43f78d-386a-4cc8-825b-259841177201 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:27 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589 Sep 09 18:33:27 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:27 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442 Sep 09 18:33:27 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:27 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7b5e3316-9245-46a2-bdbc-9837f6b70322 tempest-ProjectReaderTests-1853603710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589" returned: 0 in 0.399s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:27 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7b5e3316-9245-46a2-bdbc-9837f6b70322 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.bc43c35c-12cc-45d7-9bba-d71175ee572d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:27 devstack sudo[108629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.bc43c35c-12cc-45d7-9bba-d71175ee572d Sep 09 18:33:27 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:28 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed43f78d-386a-4cc8-825b-259841177201 tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442" returned: 0 in 0.384s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed43f78d-386a-4cc8-825b-259841177201 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.35f52897-af33-4dc7-be60-f43e119b6acd 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:28 devstack sudo[108631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.35f52897-af33-4dc7-be60-f43e119b6acd 1G Sep 09 18:33:28 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:28 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7b5e3316-9245-46a2-bdbc-9837f6b70322 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.bc43c35c-12cc-45d7-9bba-d71175ee572d" returned: 0 in 0.414s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7b5e3316-9245-46a2-bdbc-9837f6b70322 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.bc43c35c-12cc-45d7-9bba-d71175ee572d {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:28 devstack sudo[108641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.bc43c35c-12cc-45d7-9bba-d71175ee572d Sep 09 18:33:28 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:28 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed43f78d-386a-4cc8-825b-259841177201 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.35f52897-af33-4dc7-be60-f43e119b6acd 1G" returned: 0 in 0.531s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed43f78d-386a-4cc8-825b-259841177201 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01d1fa30-9117-4642-9423-0d9de100a442 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.35f52897-af33-4dc7-be60-f43e119b6acd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:28 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01d1fa30-9117-4642-9423-0d9de100a442 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.35f52897-af33-4dc7-be60-f43e119b6acd Sep 09 18:33:28 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:28 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7b5e3316-9245-46a2-bdbc-9837f6b70322 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589.bc43c35c-12cc-45d7-9bba-d71175ee572d" returned: 0 in 0.291s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:28 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7b5e3316-9245-46a2-bdbc-9837f6b70322 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-bc43c35c-12cc-45d7-9bba-d71175ee572d" released by "_delete_snapshot" :: held 1.621s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:28 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7b5e3316-9245-46a2-bdbc-9837f6b70322 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-178c0bf1-92e8-489d-ab06-0f6e9dffd589" released by "delete_snapshot" :: held 1.644s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:28 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-7b5e3316-9245-46a2-bdbc-9837f6b70322 tempest-ProjectReaderTests-1853603710 None] Created reservations ['a8441dea-4ec8-4280-8cd8-4812d2efa54c', '1460db62-70b5-4b16-bff6-9c567b13f0aa', '11935f49-bec1-40e9-b7a7-6262ff967a07', '16ecef80-1c57-4ca9-a2d4-e8f965220b68'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:28 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-7b5e3316-9245-46a2-bdbc-9837f6b70322 tempest-ProjectReaderTests-1853603710 None] Delete snapshot completed successfully. Sep 09 18:33:28 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7b5e3316-9245-46a2-bdbc-9837f6b70322 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-bc43c35c-12cc-45d7-9bba-d71175ee572d-delete_snapshot" released by "delete_snapshot" :: held 1.810s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:28 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed43f78d-386a-4cc8-825b-259841177201 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01d1fa30-9117-4642-9423-0d9de100a442 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.35f52897-af33-4dc7-be60-f43e119b6acd" returned: 0 in 0.350s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:28 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-ed43f78d-386a-4cc8-825b-259841177201 tempest-ProjectMemberTests-1445315730 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.35f52897-af33-4dc7-be60-f43e119b6acd is being set with open permissions: ugo+rw Sep 09 18:33:28 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed43f78d-386a-4cc8-825b-259841177201 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.35f52897-af33-4dc7-be60-f43e119b6acd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:28 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.35f52897-af33-4dc7-be60-f43e119b6acd Sep 09 18:33:28 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:29 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed43f78d-386a-4cc8-825b-259841177201 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.35f52897-af33-4dc7-be60-f43e119b6acd" returned: 0 in 0.287s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fa980fa4-10c5-40fb-9c22-83848306df42 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-178c0bf1-92e8-489d-ab06-0f6e9dffd589-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fa980fa4-10c5-40fb-9c22-83848306df42 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-178c0bf1-92e8-489d-ab06-0f6e9dffd589-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed43f78d-386a-4cc8-825b-259841177201 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:29 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.info Sep 09 18:33:29 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fa980fa4-10c5-40fb-9c22-83848306df42 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-quobyte-178c0bf1-92e8-489d-ab06-0f6e9dffd589" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:29 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fa980fa4-10c5-40fb-9c22-83848306df42 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-178c0bf1-92e8-489d-ab06-0f6e9dffd589" acquired by "delete_volume" :: waited 0.020s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:29 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[019afcb1-06a8-464e-bca2-7603252ad86f]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fa980fa4-10c5-40fb-9c22-83848306df42 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:29 devstack sudo[108656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589 Sep 09 18:33:29 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:29 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed43f78d-386a-4cc8-825b-259841177201 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.info" returned: 0 in 0.305s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:29 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-ed43f78d-386a-4cc8-825b-259841177201 tempest-ProjectMemberTests-1445315730 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.info is being set with open permissions: ugo+rw Sep 09 18:33:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed43f78d-386a-4cc8-825b-259841177201 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:29 devstack sudo[108659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.info Sep 09 18:33:29 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:29 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fa980fa4-10c5-40fb-9c22-83848306df42 tempest-ProjectReaderTests-1853603710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589" returned: 0 in 0.422s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fa980fa4-10c5-40fb-9c22-83848306df42 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:29 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589 Sep 09 18:33:29 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:29 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed43f78d-386a-4cc8-825b-259841177201 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.info" returned: 0 in 0.285s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:29 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ed43f78d-386a-4cc8-825b-259841177201 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.259s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:29 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ed43f78d-386a-4cc8-825b-259841177201 tempest-ProjectMemberTests-1445315730 None] Create snapshot completed successfully Sep 09 18:33:30 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fa980fa4-10c5-40fb-9c22-83848306df42 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-178c0bf1-92e8-489d-ab06-0f6e9dffd589" returned: 0 in 0.287s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fa980fa4-10c5-40fb-9c22-83848306df42 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-178c0bf1-92e8-489d-ab06-0f6e9dffd589" released by "delete_volume" :: held 0.787s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:30 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-fa980fa4-10c5-40fb-9c22-83848306df42 tempest-ProjectReaderTests-1853603710 None] Created reservations ['99367031-bfb6-4d54-b94a-3cef351c8743', '89a1d4f3-2fe3-4052-b39b-de1854e9d402', '0d0aaf8a-d8e0-446f-84a5-7fee760d6905', 'fb58a182-f3ec-42c6-a01a-95843d6fbe62'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fa980fa4-10c5-40fb-9c22-83848306df42 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fa980fa4-10c5-40fb-9c22-83848306df42 tempest-ProjectReaderTests-1853603710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:30 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fa980fa4-10c5-40fb-9c22-83848306df42 tempest-ProjectReaderTests-1853603710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:30 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-fa980fa4-10c5-40fb-9c22-83848306df42 tempest-ProjectReaderTests-1853603710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fa980fa4-10c5-40fb-9c22-83848306df42 tempest-ProjectReaderTests-1853603710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fa980fa4-10c5-40fb-9c22-83848306df42 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:30 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:33:30 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:30 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:30 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fa980fa4-10c5-40fb-9c22-83848306df42 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.275s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:30 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-fa980fa4-10c5-40fb-9c22-83848306df42 tempest-ProjectReaderTests-1853603710 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:33:30 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-fa980fa4-10c5-40fb-9c22-83848306df42 tempest-ProjectReaderTests-1853603710 None] Deleted volume successfully. Sep 09 18:33:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-fa980fa4-10c5-40fb-9c22-83848306df42 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-178c0bf1-92e8-489d-ab06-0f6e9dffd589-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f3898881-ed4f-4ca5-b614-97bc5c09c929 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-35f52897-af33-4dc7-be60-f43e119b6acd-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f3898881-ed4f-4ca5-b614-97bc5c09c929 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-35f52897-af33-4dc7-be60-f43e119b6acd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f3898881-ed4f-4ca5-b614-97bc5c09c929 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-01d1fa30-9117-4642-9423-0d9de100a442" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f3898881-ed4f-4ca5-b614-97bc5c09c929 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-01d1fa30-9117-4642-9423-0d9de100a442" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f3898881-ed4f-4ca5-b614-97bc5c09c929 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-35f52897-af33-4dc7-be60-f43e119b6acd" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:30 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f3898881-ed4f-4ca5-b614-97bc5c09c929 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-35f52897-af33-4dc7-be60-f43e119b6acd" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:30 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-f3898881-ed4f-4ca5-b614-97bc5c09c929 tempest-ProjectMemberTests-1445315730 None] Deleting offline snapshot 35f52897-af33-4dc7-be60-f43e119b6acd of volume 01d1fa30-9117-4642-9423-0d9de100a442 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-f3898881-ed4f-4ca5-b614-97bc5c09c929 tempest-ProjectMemberTests-1445315730 None] snapshot_file for this snap is: volume-01d1fa30-9117-4642-9423-0d9de100a442.35f52897-af33-4dc7-be60-f43e119b6acd {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9787674f-42c7-40aa-91ac-f4feb8fde4f9]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f3898881-ed4f-4ca5-b614-97bc5c09c929 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.35f52897-af33-4dc7-be60-f43e119b6acd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Flow 'volume_create_manager' (18786abc-5400-4f7c-ac45-736416f761e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ce7e3c-f8ff-404c-a5b9-496268a9fd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ce7e3c-f8ff-404c-a5b9-496268a9fd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-564159371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72336442-1a0a-4637-bee6-5ec42ff7d352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4e18d007b14019a7b42dce4232e50f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:31Z,use_quota=True,user_id='df73eac20f1e49dc9bbdd2f7224b6fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3578dd2-8d22-4daa-b815-79dac82921ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3578dd2-8d22-4daa-b815-79dac82921ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11eda826-b2e1-4fdb-9463-f35cb1156afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11eda826-b2e1-4fdb-9463-f35cb1156afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72336442-1a0a-4637-bee6-5ec42ff7d352', 'volume_name': 'volume-72336442-1a0a-4637-bee6-5ec42ff7d352', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9054f045-1373-48d3-9be3-d5de4bde8b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9054f045-1373-48d3-9be3-d5de4bde8b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:31 devstack sudo[108672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.35f52897-af33-4dc7-be60-f43e119b6acd Sep 09 18:33:31 devstack sudo[108672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (920ad0de-e39b-4da7-b374-f8bd68d0863d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:31 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Volume 72336442-1a0a-4637-bee6-5ec42ff7d352: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72336442-1a0a-4637-bee6-5ec42ff7d352', 'volume_size': 1} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-564159371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72336442-1a0a-4637-bee6-5ec42ff7d352,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4e18d007b14019a7b42dce4232e50f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:31Z,use_quota=True,user_id='df73eac20f1e49dc9bbdd2f7224b6fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Creating volume 72336442-1a0a-4637-bee6-5ec42ff7d352 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:33:31 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:31 devstack sudo[108674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352 1073741824 Sep 09 18:33:31 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:31 devstack sudo[108672]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f3898881-ed4f-4ca5-b614-97bc5c09c929 tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.35f52897-af33-4dc7-be60-f43e119b6acd" returned: 0 in 0.423s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-f3898881-ed4f-4ca5-b614-97bc5c09c929 tempest-ProjectMemberTests-1445315730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01d1fa30-9117-4642-9423-0d9de100a442(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[c231ef26-42ef-44e8-ba96-a0e2bdca28fd]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f3898881-ed4f-4ca5-b614-97bc5c09c929 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:31 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352 1073741824" returned: 0 in 0.428s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:31 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442 Sep 09 18:33:31 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:31 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352 Sep 09 18:33:31 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:31 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f3898881-ed4f-4ca5-b614-97bc5c09c929 tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442" returned: 0 in 0.398s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f3898881-ed4f-4ca5-b614-97bc5c09c929 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.35f52897-af33-4dc7-be60-f43e119b6acd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:31 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352" returned: 0 in 0.253s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:31 devstack sudo[108691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.35f52897-af33-4dc7-be60-f43e119b6acd Sep 09 18:33:31 devstack sudo[108691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (920ad0de-e39b-4da7-b374-f8bd68d0863d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72336442-1a0a-4637-bee6-5ec42ff7d352', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (818a7535-86d2-4f4e-89ec-2235216b3fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:31 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Volume volume-72336442-1a0a-4637-bee6-5ec42ff7d352 (72336442-1a0a-4637-bee6-5ec42ff7d352): created successfully Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (818a7535-86d2-4f4e-89ec-2235216b3fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:31 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Flow 'volume_create_manager' (18786abc-5400-4f7c-ac45-736416f761e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:31 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-8e7bec98-b42a-4d6f-a6a1-5e78640d1a13 tempest-ProjectReaderTests-1853603710 None] Created volume successfully. Sep 09 18:33:32 devstack sudo[108691]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f3898881-ed4f-4ca5-b614-97bc5c09c929 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.35f52897-af33-4dc7-be60-f43e119b6acd" returned: 0 in 0.338s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f3898881-ed4f-4ca5-b614-97bc5c09c929 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.35f52897-af33-4dc7-be60-f43e119b6acd {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:32 devstack sudo[108696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.35f52897-af33-4dc7-be60-f43e119b6acd Sep 09 18:33:32 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:32 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:32 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-f3898881-ed4f-4ca5-b614-97bc5c09c929 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442.35f52897-af33-4dc7-be60-f43e119b6acd" returned: 0 in 0.250s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f3898881-ed4f-4ca5-b614-97bc5c09c929 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-35f52897-af33-4dc7-be60-f43e119b6acd" released by "_delete_snapshot" :: held 1.543s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f3898881-ed4f-4ca5-b614-97bc5c09c929 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-01d1fa30-9117-4642-9423-0d9de100a442" released by "delete_snapshot" :: held 1.576s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:32 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-f3898881-ed4f-4ca5-b614-97bc5c09c929 tempest-ProjectMemberTests-1445315730 None] Created reservations ['a98358b7-6840-4949-919b-8cbec7123759', '77188bdc-a6b8-4b6d-9683-3b0aea114f1e', 'dc9fe984-8d34-4022-80fc-8d48a0c85dd1', '4eee206b-60e1-48b6-acaf-06af368d6bea'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:32 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-f3898881-ed4f-4ca5-b614-97bc5c09c929 tempest-ProjectMemberTests-1445315730 None] Delete snapshot completed successfully. Sep 09 18:33:32 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-f3898881-ed4f-4ca5-b614-97bc5c09c929 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-35f52897-af33-4dc7-be60-f43e119b6acd-delete_snapshot" released by "delete_snapshot" :: held 1.723s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8ee3343e-3843-4766-a0aa-c74f49c4da9a tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-01d1fa30-9117-4642-9423-0d9de100a442-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8ee3343e-3843-4766-a0aa-c74f49c4da9a tempest-ProjectMemberTests-1445315730 None] Lock "cinder-01d1fa30-9117-4642-9423-0d9de100a442-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8ee3343e-3843-4766-a0aa-c74f49c4da9a tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-01d1fa30-9117-4642-9423-0d9de100a442" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8ee3343e-3843-4766-a0aa-c74f49c4da9a tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-01d1fa30-9117-4642-9423-0d9de100a442" acquired by "delete_volume" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[388b602f-e783-400e-9603-e591475110e7]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8ee3343e-3843-4766-a0aa-c74f49c4da9a tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b7cd4d38-ef25-44d9-999f-b2dc2a331c6f tempest-ProjectReaderTests-1853603710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b7cd4d38-ef25-44d9-999f-b2dc2a331c6f tempest-ProjectReaderTests-1853603710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b7cd4d38-ef25-44d9-999f-b2dc2a331c6f tempest-ProjectReaderTests-1853603710 None] Creating offline snapshot 1c49739c-5909-4d54-a94d-a1823292c370 of volume 72336442-1a0a-4637-bee6-5ec42ff7d352 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53aeb27-698e-4013-8a7c-00df838a22bf]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7cd4d38-ef25-44d9-999f-b2dc2a331c6f tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:33 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442 Sep 09 18:33:33 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:33 devstack sudo[108700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352 Sep 09 18:33:33 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:33 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8ee3343e-3843-4766-a0aa-c74f49c4da9a tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442" returned: 0 in 0.359s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8ee3343e-3843-4766-a0aa-c74f49c4da9a tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:33 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442 Sep 09 18:33:33 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:33 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7cd4d38-ef25-44d9-999f-b2dc2a331c6f tempest-ProjectReaderTests-1853603710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352" returned: 0 in 0.349s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7cd4d38-ef25-44d9-999f-b2dc2a331c6f tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.1c49739c-5909-4d54-a94d-a1823292c370 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:33 devstack sudo[108711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.1c49739c-5909-4d54-a94d-a1823292c370 1G Sep 09 18:33:33 devstack sudo[108711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:33 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8ee3343e-3843-4766-a0aa-c74f49c4da9a tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-01d1fa30-9117-4642-9423-0d9de100a442" returned: 0 in 0.243s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8ee3343e-3843-4766-a0aa-c74f49c4da9a tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-01d1fa30-9117-4642-9423-0d9de100a442" released by "delete_volume" :: held 0.670s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-8ee3343e-3843-4766-a0aa-c74f49c4da9a tempest-ProjectMemberTests-1445315730 None] Created reservations ['6cc846a4-f456-45fa-8bd1-2419bae756d4', 'faf5330f-9f85-412c-993a-abffb8cf9fb5', '90331ab7-24db-4c69-810f-db2862a5462d', 'bc930255-3b90-422e-9b00-650adff71882'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8ee3343e-3843-4766-a0aa-c74f49c4da9a tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8ee3343e-3843-4766-a0aa-c74f49c4da9a tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8ee3343e-3843-4766-a0aa-c74f49c4da9a tempest-ProjectMemberTests-1445315730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8ee3343e-3843-4766-a0aa-c74f49c4da9a tempest-ProjectMemberTests-1445315730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8ee3343e-3843-4766-a0aa-c74f49c4da9a tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:33 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8ee3343e-3843-4766-a0aa-c74f49c4da9a tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:33 devstack sudo[108717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:33:33 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:33 devstack sudo[108711]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7cd4d38-ef25-44d9-999f-b2dc2a331c6f tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.1c49739c-5909-4d54-a94d-a1823292c370 1G" returned: 0 in 0.405s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7cd4d38-ef25-44d9-999f-b2dc2a331c6f tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72336442-1a0a-4637-bee6-5ec42ff7d352 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.1c49739c-5909-4d54-a94d-a1823292c370 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:34 devstack sudo[108720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72336442-1a0a-4637-bee6-5ec42ff7d352 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.1c49739c-5909-4d54-a94d-a1823292c370 Sep 09 18:33:34 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:34 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8ee3343e-3843-4766-a0aa-c74f49c4da9a tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.263s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-8ee3343e-3843-4766-a0aa-c74f49c4da9a tempest-ProjectMemberTests-1445315730 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:33:34 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-8ee3343e-3843-4766-a0aa-c74f49c4da9a tempest-ProjectMemberTests-1445315730 None] Deleted volume successfully. Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8ee3343e-3843-4766-a0aa-c74f49c4da9a tempest-ProjectMemberTests-1445315730 None] Lock "cinder-01d1fa30-9117-4642-9423-0d9de100a442-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:34 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7cd4d38-ef25-44d9-999f-b2dc2a331c6f tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72336442-1a0a-4637-bee6-5ec42ff7d352 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.1c49739c-5909-4d54-a94d-a1823292c370" returned: 0 in 0.304s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:34 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-b7cd4d38-ef25-44d9-999f-b2dc2a331c6f tempest-ProjectReaderTests-1853603710 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.1c49739c-5909-4d54-a94d-a1823292c370 is being set with open permissions: ugo+rw Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7cd4d38-ef25-44d9-999f-b2dc2a331c6f tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.1c49739c-5909-4d54-a94d-a1823292c370 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:34 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.1c49739c-5909-4d54-a94d-a1823292c370 Sep 09 18:33:34 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:34 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7cd4d38-ef25-44d9-999f-b2dc2a331c6f tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.1c49739c-5909-4d54-a94d-a1823292c370" returned: 0 in 0.265s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7cd4d38-ef25-44d9-999f-b2dc2a331c6f tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:34 devstack sudo[108729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.info Sep 09 18:33:34 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Flow 'volume_create_manager' (a61de292-7325-42e5-ae40-9166d9d8e2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e1f914c-5568-4698-a057-d58694f2ab92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e1f914c-5568-4698-a057-d58694f2ab92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1306869732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a465086-321c-47df-be9f-c234df620402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16d9e4115144c68db4659423a5963a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:35Z,use_quota=True,user_id='b4c31a80b5c54f3eb121e7c39fe61f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76617a3a-340a-48ec-8874-11246d53e8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76617a3a-340a-48ec-8874-11246d53e8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44bb38e9-b46a-4438-bef6-b211d213bdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44bb38e9-b46a-4438-bef6-b211d213bdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a465086-321c-47df-be9f-c234df620402', 'volume_name': 'volume-1a465086-321c-47df-be9f-c234df620402', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783ffdfd-84a5-408e-aabb-8d8de46590b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783ffdfd-84a5-408e-aabb-8d8de46590b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b2fe9f-33f3-4a42-82bd-618e3106463a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:34 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Volume 1a465086-321c-47df-be9f-c234df620402: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a465086-321c-47df-be9f-c234df620402', 'volume_size': 1} Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:34 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7cd4d38-ef25-44d9-999f-b2dc2a331c6f tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.info" returned: 0 in 0.263s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:34 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-b7cd4d38-ef25-44d9-999f-b2dc2a331c6f tempest-ProjectReaderTests-1853603710 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.info is being set with open permissions: ugo+rw Sep 09 18:33:34 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7cd4d38-ef25-44d9-999f-b2dc2a331c6f tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:34 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.info Sep 09 18:33:34 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:35 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7cd4d38-ef25-44d9-999f-b2dc2a331c6f tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.info" returned: 0 in 0.241s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b7cd4d38-ef25-44d9-999f-b2dc2a331c6f tempest-ProjectReaderTests-1853603710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.901s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.360s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1306869732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a465086-321c-47df-be9f-c234df620402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16d9e4115144c68db4659423a5963a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:35Z,use_quota=True,user_id='b4c31a80b5c54f3eb121e7c39fe61f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Creating volume 1a465086-321c-47df-be9f-c234df620402 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:33:35 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:35 devstack sudo[108735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402 1073741824 Sep 09 18:33:35 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:35 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-b7cd4d38-ef25-44d9-999f-b2dc2a331c6f tempest-ProjectReaderTests-1853603710 None] Create snapshot completed successfully Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ee593406-9342-4142-8f3d-1974986e72b1 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-1c49739c-5909-4d54-a94d-a1823292c370-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ee593406-9342-4142-8f3d-1974986e72b1 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-1c49739c-5909-4d54-a94d-a1823292c370-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ee593406-9342-4142-8f3d-1974986e72b1 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-quobyte-72336442-1a0a-4637-bee6-5ec42ff7d352" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ee593406-9342-4142-8f3d-1974986e72b1 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-72336442-1a0a-4637-bee6-5ec42ff7d352" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ee593406-9342-4142-8f3d-1974986e72b1 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-quobyte-1c49739c-5909-4d54-a94d-a1823292c370" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ee593406-9342-4142-8f3d-1974986e72b1 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-1c49739c-5909-4d54-a94d-a1823292c370" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-ee593406-9342-4142-8f3d-1974986e72b1 tempest-ProjectReaderTests-1853603710 None] Deleting offline snapshot 1c49739c-5909-4d54-a94d-a1823292c370 of volume 72336442-1a0a-4637-bee6-5ec42ff7d352 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-ee593406-9342-4142-8f3d-1974986e72b1 tempest-ProjectReaderTests-1853603710 None] snapshot_file for this snap is: volume-72336442-1a0a-4637-bee6-5ec42ff7d352.1c49739c-5909-4d54-a94d-a1823292c370 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccd3e34-2d87-4146-b5ac-6726ca6f32c7]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ee593406-9342-4142-8f3d-1974986e72b1 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.1c49739c-5909-4d54-a94d-a1823292c370 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:35 devstack sudo[108740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.1c49739c-5909-4d54-a94d-a1823292c370 Sep 09 18:33:35 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:35 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402 1073741824" returned: 0 in 0.435s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:35 devstack sudo[108743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402 Sep 09 18:33:35 devstack sudo[108743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:35 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ee593406-9342-4142-8f3d-1974986e72b1 tempest-ProjectReaderTests-1853603710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.1c49739c-5909-4d54-a94d-a1823292c370" returned: 0 in 0.398s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-ee593406-9342-4142-8f3d-1974986e72b1 tempest-ProjectReaderTests-1853603710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72336442-1a0a-4637-bee6-5ec42ff7d352(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:33:35 devstack sudo[108743]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402" returned: 0 in 0.280s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51e2933-3cbf-49cd-814f-8c0634e635f7]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ee593406-9342-4142-8f3d-1974986e72b1 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b2fe9f-33f3-4a42-82bd-618e3106463a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a465086-321c-47df-be9f-c234df620402', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c66d2d9-d3da-4829-9da2-2692b1a87494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:35 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Volume volume-1a465086-321c-47df-be9f-c234df620402 (1a465086-321c-47df-be9f-c234df620402): created successfully Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c66d2d9-d3da-4829-9da2-2692b1a87494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:35 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Flow 'volume_create_manager' (a61de292-7325-42e5-ae40-9166d9d8e2b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:35 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-348a1c93-544e-4564-b90f-a97c966b7ce0 tempest-ProjectMemberTests-1445315730 None] Created volume successfully. Sep 09 18:33:36 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352 Sep 09 18:33:36 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:36 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ee593406-9342-4142-8f3d-1974986e72b1 tempest-ProjectReaderTests-1853603710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352" returned: 0 in 0.364s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ee593406-9342-4142-8f3d-1974986e72b1 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.1c49739c-5909-4d54-a94d-a1823292c370 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:36 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.1c49739c-5909-4d54-a94d-a1823292c370 Sep 09 18:33:36 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:36 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ee593406-9342-4142-8f3d-1974986e72b1 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.1c49739c-5909-4d54-a94d-a1823292c370" returned: 0 in 0.311s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ee593406-9342-4142-8f3d-1974986e72b1 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.1c49739c-5909-4d54-a94d-a1823292c370 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:36 devstack sudo[108760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.1c49739c-5909-4d54-a94d-a1823292c370 Sep 09 18:33:36 devstack sudo[108760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:36 devstack sudo[108760]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ee593406-9342-4142-8f3d-1974986e72b1 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352.1c49739c-5909-4d54-a94d-a1823292c370" returned: 0 in 0.260s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ee593406-9342-4142-8f3d-1974986e72b1 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-1c49739c-5909-4d54-a94d-a1823292c370" released by "_delete_snapshot" :: held 1.442s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:36 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ee593406-9342-4142-8f3d-1974986e72b1 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-72336442-1a0a-4637-bee6-5ec42ff7d352" released by "delete_snapshot" :: held 1.469s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:36 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-ee593406-9342-4142-8f3d-1974986e72b1 tempest-ProjectReaderTests-1853603710 None] Created reservations ['e76a3958-cc35-446b-b9ca-1e0805fafd7d', '9ea85b78-8cad-4eea-ac12-3144b6f03484', 'd6a9f34c-1e7c-43b1-8eef-0c46fe6470c7', '83adc404-2754-4e67-90b5-4061320a9849'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e61806a3-d352-4a1d-b43b-bc5c54b12283 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:36 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e61806a3-d352-4a1d-b43b-bc5c54b12283 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:36 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-e61806a3-d352-4a1d-b43b-bc5c54b12283 tempest-ProjectMemberTests-1445315730 None] Creating offline snapshot 846d0528-4141-4be8-b9f9-509765243a53 of volume 1a465086-321c-47df-be9f-c234df620402 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:33:37 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ee593406-9342-4142-8f3d-1974986e72b1 tempest-ProjectReaderTests-1853603710 None] Delete snapshot completed successfully. Sep 09 18:33:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-ee593406-9342-4142-8f3d-1974986e72b1 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-1c49739c-5909-4d54-a94d-a1823292c370-delete_snapshot" released by "delete_snapshot" :: held 1.634s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:37 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe101f00-391a-479c-b75f-a1e6ef5a78fc]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e61806a3-d352-4a1d-b43b-bc5c54b12283 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:37 devstack sudo[108763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402 Sep 09 18:33:37 devstack sudo[108763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:37 devstack sudo[108763]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e61806a3-d352-4a1d-b43b-bc5c54b12283 tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402" returned: 0 in 0.357s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e61806a3-d352-4a1d-b43b-bc5c54b12283 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.846d0528-4141-4be8-b9f9-509765243a53 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:37 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.846d0528-4141-4be8-b9f9-509765243a53 1G Sep 09 18:33:37 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0930bfa4-d122-43ce-8b2b-2d3048cd1345 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-72336442-1a0a-4637-bee6-5ec42ff7d352-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0930bfa4-d122-43ce-8b2b-2d3048cd1345 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-72336442-1a0a-4637-bee6-5ec42ff7d352-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0930bfa4-d122-43ce-8b2b-2d3048cd1345 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-quobyte-72336442-1a0a-4637-bee6-5ec42ff7d352" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:37 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0930bfa4-d122-43ce-8b2b-2d3048cd1345 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-72336442-1a0a-4637-bee6-5ec42ff7d352" acquired by "delete_volume" :: waited 0.015s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:37 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f947a9-ce3a-42f5-a3d7-926e1a01564c]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0930bfa4-d122-43ce-8b2b-2d3048cd1345 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:37 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352 Sep 09 18:33:37 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:37 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e61806a3-d352-4a1d-b43b-bc5c54b12283 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.846d0528-4141-4be8-b9f9-509765243a53 1G" returned: 0 in 0.397s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:37 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e61806a3-d352-4a1d-b43b-bc5c54b12283 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a465086-321c-47df-be9f-c234df620402 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.846d0528-4141-4be8-b9f9-509765243a53 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:37 devstack sudo[108775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a465086-321c-47df-be9f-c234df620402 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.846d0528-4141-4be8-b9f9-509765243a53 Sep 09 18:33:37 devstack sudo[108775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:38 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0930bfa4-d122-43ce-8b2b-2d3048cd1345 tempest-ProjectReaderTests-1853603710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352" returned: 0 in 0.388s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0930bfa4-d122-43ce-8b2b-2d3048cd1345 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:38 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352 Sep 09 18:33:38 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:38 devstack sudo[108775]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e61806a3-d352-4a1d-b43b-bc5c54b12283 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a465086-321c-47df-be9f-c234df620402 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.846d0528-4141-4be8-b9f9-509765243a53" returned: 0 in 0.302s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:38 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-e61806a3-d352-4a1d-b43b-bc5c54b12283 tempest-ProjectMemberTests-1445315730 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.846d0528-4141-4be8-b9f9-509765243a53 is being set with open permissions: ugo+rw Sep 09 18:33:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e61806a3-d352-4a1d-b43b-bc5c54b12283 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.846d0528-4141-4be8-b9f9-509765243a53 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:38 devstack sudo[108787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.846d0528-4141-4be8-b9f9-509765243a53 Sep 09 18:33:38 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:38 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0930bfa4-d122-43ce-8b2b-2d3048cd1345 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-72336442-1a0a-4637-bee6-5ec42ff7d352" returned: 0 in 0.248s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:38 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0930bfa4-d122-43ce-8b2b-2d3048cd1345 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-72336442-1a0a-4637-bee6-5ec42ff7d352" released by "delete_volume" :: held 0.691s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:38 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e61806a3-d352-4a1d-b43b-bc5c54b12283 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.846d0528-4141-4be8-b9f9-509765243a53" returned: 0 in 0.248s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:38 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-0930bfa4-d122-43ce-8b2b-2d3048cd1345 tempest-ProjectReaderTests-1853603710 None] Created reservations ['27773346-0e5e-435e-a61f-c4f7f4900250', 'e1db974c-fc0a-4565-90a7-bb0612c1a085', 'b4752810-1af5-4bc3-87a2-182bfec50839', '6c372999-349e-4f71-a72d-e0a3c6aa90b5'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e61806a3-d352-4a1d-b43b-bc5c54b12283 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:38 devstack sudo[108791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.info Sep 09 18:33:38 devstack sudo[108791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0930bfa4-d122-43ce-8b2b-2d3048cd1345 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0930bfa4-d122-43ce-8b2b-2d3048cd1345 tempest-ProjectReaderTests-1853603710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0930bfa4-d122-43ce-8b2b-2d3048cd1345 tempest-ProjectReaderTests-1853603710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:38 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-0930bfa4-d122-43ce-8b2b-2d3048cd1345 tempest-ProjectReaderTests-1853603710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-0930bfa4-d122-43ce-8b2b-2d3048cd1345 tempest-ProjectReaderTests-1853603710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0930bfa4-d122-43ce-8b2b-2d3048cd1345 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:38 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:33:38 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:38 devstack sudo[108791]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e61806a3-d352-4a1d-b43b-bc5c54b12283 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.info" returned: 0 in 0.253s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:38 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-e61806a3-d352-4a1d-b43b-bc5c54b12283 tempest-ProjectMemberTests-1445315730 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.info is being set with open permissions: ugo+rw Sep 09 18:33:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e61806a3-d352-4a1d-b43b-bc5c54b12283 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:38 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.info Sep 09 18:33:38 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:38 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0930bfa4-d122-43ce-8b2b-2d3048cd1345 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.261s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:38 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-0930bfa4-d122-43ce-8b2b-2d3048cd1345 tempest-ProjectReaderTests-1853603710 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:33:38 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-0930bfa4-d122-43ce-8b2b-2d3048cd1345 tempest-ProjectReaderTests-1853603710 None] Deleted volume successfully. Sep 09 18:33:38 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0930bfa4-d122-43ce-8b2b-2d3048cd1345 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-72336442-1a0a-4637-bee6-5ec42ff7d352-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:38 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e61806a3-d352-4a1d-b43b-bc5c54b12283 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.info" returned: 0 in 0.266s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:38 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e61806a3-d352-4a1d-b43b-bc5c54b12283 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:38 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-e61806a3-d352-4a1d-b43b-bc5c54b12283 tempest-ProjectMemberTests-1445315730 None] Create snapshot completed successfully Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0e658126-2a46-40c7-ae37-ab1d7375fb3d tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-846d0528-4141-4be8-b9f9-509765243a53-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Flow 'volume_create_manager' (49729e5d-3c16-406b-b417-281845699412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a224844-14e1-42f7-8128-5d567d5f54a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0e658126-2a46-40c7-ae37-ab1d7375fb3d tempest-ProjectMemberTests-1445315730 None] Lock "cinder-846d0528-4141-4be8-b9f9-509765243a53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0e658126-2a46-40c7-ae37-ab1d7375fb3d tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-1a465086-321c-47df-be9f-c234df620402" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a224844-14e1-42f7-8128-5d567d5f54a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1619635271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=597729ed-ea4e-4fa1-91bf-3eac615837f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4e18d007b14019a7b42dce4232e50f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:39Z,use_quota=True,user_id='df73eac20f1e49dc9bbdd2f7224b6fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a5912f-f51b-4519-87c9-a5464d0ffe83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a5912f-f51b-4519-87c9-a5464d0ffe83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d187ef9b-4f6f-458b-9dc5-22b4f3668921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d187ef9b-4f6f-458b-9dc5-22b4f3668921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '597729ed-ea4e-4fa1-91bf-3eac615837f4', 'volume_name': 'volume-597729ed-ea4e-4fa1-91bf-3eac615837f4', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc71ed6-bc54-4890-bcf8-43e8babdeccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc71ed6-bc54-4890-bcf8-43e8babdeccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e468671-c16f-44e9-a0e5-1367a3c37ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:39 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Volume 597729ed-ea4e-4fa1-91bf-3eac615837f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-597729ed-ea4e-4fa1-91bf-3eac615837f4', 'volume_size': 1} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1619635271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=597729ed-ea4e-4fa1-91bf-3eac615837f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4e18d007b14019a7b42dce4232e50f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:39Z,use_quota=True,user_id='df73eac20f1e49dc9bbdd2f7224b6fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Creating volume 597729ed-ea4e-4fa1-91bf-3eac615837f4 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:33:39 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0e658126-2a46-40c7-ae37-ab1d7375fb3d tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-1a465086-321c-47df-be9f-c234df620402" acquired by "delete_snapshot" :: waited 0.079s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0e658126-2a46-40c7-ae37-ab1d7375fb3d tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-846d0528-4141-4be8-b9f9-509765243a53" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:39 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4 1073741824 Sep 09 18:33:39 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0e658126-2a46-40c7-ae37-ab1d7375fb3d tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-846d0528-4141-4be8-b9f9-509765243a53" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-0e658126-2a46-40c7-ae37-ab1d7375fb3d tempest-ProjectMemberTests-1445315730 None] Deleting offline snapshot 846d0528-4141-4be8-b9f9-509765243a53 of volume 1a465086-321c-47df-be9f-c234df620402 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-0e658126-2a46-40c7-ae37-ab1d7375fb3d tempest-ProjectMemberTests-1445315730 None] snapshot_file for this snap is: volume-1a465086-321c-47df-be9f-c234df620402.846d0528-4141-4be8-b9f9-509765243a53 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[04482fc9-6fb9-418d-8766-186366427752]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0e658126-2a46-40c7-ae37-ab1d7375fb3d tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.846d0528-4141-4be8-b9f9-509765243a53 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:39 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.846d0528-4141-4be8-b9f9-509765243a53 Sep 09 18:33:39 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:39 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4 1073741824" returned: 0 in 0.416s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:39 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0e658126-2a46-40c7-ae37-ab1d7375fb3d tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.846d0528-4141-4be8-b9f9-509765243a53" returned: 0 in 0.407s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-0e658126-2a46-40c7-ae37-ab1d7375fb3d tempest-ProjectMemberTests-1445315730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a465086-321c-47df-be9f-c234df620402(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:33:39 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4 Sep 09 18:33:39 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb6db3f-4bdd-4a62-89a9-e209b3a47b01]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0e658126-2a46-40c7-ae37-ab1d7375fb3d tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:39 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402 Sep 09 18:33:39 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:39 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4" returned: 0 in 0.244s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e468671-c16f-44e9-a0e5-1367a3c37ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-597729ed-ea4e-4fa1-91bf-3eac615837f4', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133663d8-e432-4c90-99a6-93bcdfde2196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:39 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Volume volume-597729ed-ea4e-4fa1-91bf-3eac615837f4 (597729ed-ea4e-4fa1-91bf-3eac615837f4): created successfully Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133663d8-e432-4c90-99a6-93bcdfde2196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:39 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Flow 'volume_create_manager' (49729e5d-3c16-406b-b417-281845699412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:39 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-7b4eb919-a933-422f-9e99-02063d78a69a tempest-ProjectReaderTests-1853603710 None] Created volume successfully. Sep 09 18:33:40 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0e658126-2a46-40c7-ae37-ab1d7375fb3d tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402" returned: 0 in 0.385s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0e658126-2a46-40c7-ae37-ab1d7375fb3d tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.846d0528-4141-4be8-b9f9-509765243a53 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:40 devstack sudo[108818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.846d0528-4141-4be8-b9f9-509765243a53 Sep 09 18:33:40 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fa999461-f797-47a5-9177-8be71b537a1f tempest-ProjectReaderTests-1853603710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fa999461-f797-47a5-9177-8be71b537a1f tempest-ProjectReaderTests-1853603710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:40 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-fa999461-f797-47a5-9177-8be71b537a1f tempest-ProjectReaderTests-1853603710 None] Creating offline snapshot 20a3f042-570c-417a-a302-1a42f65b0841 of volume 597729ed-ea4e-4fa1-91bf-3eac615837f4 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:33:40 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a75cf2e-a7e7-4ecf-ae4c-ab1a2812f229]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fa999461-f797-47a5-9177-8be71b537a1f tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:40 devstack sudo[108821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4 Sep 09 18:33:40 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:40 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0e658126-2a46-40c7-ae37-ab1d7375fb3d tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.846d0528-4141-4be8-b9f9-509765243a53" returned: 0 in 0.348s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0e658126-2a46-40c7-ae37-ab1d7375fb3d tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.846d0528-4141-4be8-b9f9-509765243a53 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:40 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.846d0528-4141-4be8-b9f9-509765243a53 Sep 09 18:33:40 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:40 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fa999461-f797-47a5-9177-8be71b537a1f tempest-ProjectReaderTests-1853603710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4" returned: 0 in 0.369s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fa999461-f797-47a5-9177-8be71b537a1f tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.20a3f042-570c-417a-a302-1a42f65b0841 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:40 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:40 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-0e658126-2a46-40c7-ae37-ab1d7375fb3d tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402.846d0528-4141-4be8-b9f9-509765243a53" returned: 0 in 0.258s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:40 devstack sudo[108831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.20a3f042-570c-417a-a302-1a42f65b0841 1G Sep 09 18:33:40 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:40 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0e658126-2a46-40c7-ae37-ab1d7375fb3d tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-846d0528-4141-4be8-b9f9-509765243a53" released by "_delete_snapshot" :: held 1.489s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:40 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0e658126-2a46-40c7-ae37-ab1d7375fb3d tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-1a465086-321c-47df-be9f-c234df620402" released by "delete_snapshot" :: held 1.515s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:40 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-0e658126-2a46-40c7-ae37-ab1d7375fb3d tempest-ProjectMemberTests-1445315730 None] Created reservations ['0510e37b-62af-48d8-8362-a9b491b8e3d2', 'fab7c927-76bd-4e6e-a771-147611bc9cac', '4d5ed574-bee6-4bb8-9bac-07c3c17dfa72', 'c2873f19-4633-4cab-9259-37cc9f6659d0'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:40 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-0e658126-2a46-40c7-ae37-ab1d7375fb3d tempest-ProjectMemberTests-1445315730 None] Delete snapshot completed successfully. Sep 09 18:33:40 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-0e658126-2a46-40c7-ae37-ab1d7375fb3d tempest-ProjectMemberTests-1445315730 None] Lock "cinder-846d0528-4141-4be8-b9f9-509765243a53-delete_snapshot" released by "delete_snapshot" :: held 1.734s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:41 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fa999461-f797-47a5-9177-8be71b537a1f tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.20a3f042-570c-417a-a302-1a42f65b0841 1G" returned: 0 in 0.407s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fa999461-f797-47a5-9177-8be71b537a1f tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-597729ed-ea4e-4fa1-91bf-3eac615837f4 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.20a3f042-570c-417a-a302-1a42f65b0841 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:41 devstack sudo[108837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-597729ed-ea4e-4fa1-91bf-3eac615837f4 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.20a3f042-570c-417a-a302-1a42f65b0841 Sep 09 18:33:41 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:41 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7a6614cd-9930-40df-97d9-ebf6a2641f16 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-1a465086-321c-47df-be9f-c234df620402-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:41 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7a6614cd-9930-40df-97d9-ebf6a2641f16 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-1a465086-321c-47df-be9f-c234df620402-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:41 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7a6614cd-9930-40df-97d9-ebf6a2641f16 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-1a465086-321c-47df-be9f-c234df620402" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:41 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7a6614cd-9930-40df-97d9-ebf6a2641f16 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-1a465086-321c-47df-be9f-c234df620402" acquired by "delete_volume" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:41 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ffca2b-fca6-4ee9-9191-8ec13d0f5694]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7a6614cd-9930-40df-97d9-ebf6a2641f16 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:41 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fa999461-f797-47a5-9177-8be71b537a1f tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-597729ed-ea4e-4fa1-91bf-3eac615837f4 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.20a3f042-570c-417a-a302-1a42f65b0841" returned: 0 in 0.323s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:41 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-fa999461-f797-47a5-9177-8be71b537a1f tempest-ProjectReaderTests-1853603710 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.20a3f042-570c-417a-a302-1a42f65b0841 is being set with open permissions: ugo+rw Sep 09 18:33:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fa999461-f797-47a5-9177-8be71b537a1f tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.20a3f042-570c-417a-a302-1a42f65b0841 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:41 devstack sudo[108843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.20a3f042-570c-417a-a302-1a42f65b0841 Sep 09 18:33:41 devstack sudo[108843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:41 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402 Sep 09 18:33:41 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:41 devstack sudo[108843]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fa999461-f797-47a5-9177-8be71b537a1f tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.20a3f042-570c-417a-a302-1a42f65b0841" returned: 0 in 0.239s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fa999461-f797-47a5-9177-8be71b537a1f tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:41 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.info Sep 09 18:33:41 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:41 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7a6614cd-9930-40df-97d9-ebf6a2641f16 tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402" returned: 0 in 0.363s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7a6614cd-9930-40df-97d9-ebf6a2641f16 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:41 devstack sudo[108852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402 Sep 09 18:33:41 devstack sudo[108852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:41 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fa999461-f797-47a5-9177-8be71b537a1f tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.info" returned: 0 in 0.259s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:41 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-fa999461-f797-47a5-9177-8be71b537a1f tempest-ProjectReaderTests-1853603710 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.info is being set with open permissions: ugo+rw Sep 09 18:33:41 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fa999461-f797-47a5-9177-8be71b537a1f tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:42 devstack sudo[108856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.info Sep 09 18:33:42 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:42 devstack sudo[108852]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7a6614cd-9930-40df-97d9-ebf6a2641f16 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-1a465086-321c-47df-be9f-c234df620402" returned: 0 in 0.262s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7a6614cd-9930-40df-97d9-ebf6a2641f16 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-1a465086-321c-47df-be9f-c234df620402" released by "delete_volume" :: held 0.689s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-7a6614cd-9930-40df-97d9-ebf6a2641f16 tempest-ProjectMemberTests-1445315730 None] Created reservations ['c10beec6-6646-4dc9-8622-63ca11b3ac71', '5240104e-ed62-4b9d-865b-bfdbd5ad7f55', '3a9559ad-0c24-4ef3-ab5e-dda13f63ac4b', '13a0c46e-6242-40f8-b281-8168279a55c3'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7a6614cd-9930-40df-97d9-ebf6a2641f16 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7a6614cd-9930-40df-97d9-ebf6a2641f16 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7a6614cd-9930-40df-97d9-ebf6a2641f16 tempest-ProjectMemberTests-1445315730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7a6614cd-9930-40df-97d9-ebf6a2641f16 tempest-ProjectMemberTests-1445315730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7a6614cd-9930-40df-97d9-ebf6a2641f16 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7a6614cd-9930-40df-97d9-ebf6a2641f16 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:42 devstack sudo[108858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:33:42 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:42 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-fa999461-f797-47a5-9177-8be71b537a1f tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.info" returned: 0 in 0.254s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-fa999461-f797-47a5-9177-8be71b537a1f tempest-ProjectReaderTests-1853603710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.936s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:42 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-fa999461-f797-47a5-9177-8be71b537a1f tempest-ProjectReaderTests-1853603710 None] Create snapshot completed successfully Sep 09 18:33:42 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7a6614cd-9930-40df-97d9-ebf6a2641f16 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.282s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-7a6614cd-9930-40df-97d9-ebf6a2641f16 tempest-ProjectMemberTests-1445315730 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c39f4915-5bb0-4851-b242-e2b5756718c7 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-20a3f042-570c-417a-a302-1a42f65b0841-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:42 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-7a6614cd-9930-40df-97d9-ebf6a2641f16 tempest-ProjectMemberTests-1445315730 None] Deleted volume successfully. Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c39f4915-5bb0-4851-b242-e2b5756718c7 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-20a3f042-570c-417a-a302-1a42f65b0841-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c39f4915-5bb0-4851-b242-e2b5756718c7 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-quobyte-597729ed-ea4e-4fa1-91bf-3eac615837f4" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-7a6614cd-9930-40df-97d9-ebf6a2641f16 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-1a465086-321c-47df-be9f-c234df620402-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c39f4915-5bb0-4851-b242-e2b5756718c7 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-597729ed-ea4e-4fa1-91bf-3eac615837f4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c39f4915-5bb0-4851-b242-e2b5756718c7 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-quobyte-20a3f042-570c-417a-a302-1a42f65b0841" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c39f4915-5bb0-4851-b242-e2b5756718c7 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-20a3f042-570c-417a-a302-1a42f65b0841" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-c39f4915-5bb0-4851-b242-e2b5756718c7 tempest-ProjectReaderTests-1853603710 None] Deleting offline snapshot 20a3f042-570c-417a-a302-1a42f65b0841 of volume 597729ed-ea4e-4fa1-91bf-3eac615837f4 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-c39f4915-5bb0-4851-b242-e2b5756718c7 tempest-ProjectReaderTests-1853603710 None] snapshot_file for this snap is: volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.20a3f042-570c-417a-a302-1a42f65b0841 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[accfa1fc-5016-4de0-88cb-e714434b81a9]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c39f4915-5bb0-4851-b242-e2b5756718c7 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.20a3f042-570c-417a-a302-1a42f65b0841 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:42 devstack sudo[108862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.20a3f042-570c-417a-a302-1a42f65b0841 Sep 09 18:33:42 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:33:42 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Flow 'volume_create_manager' (5a5ce360-840f-4c85-bb7e-1923d1eee352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94391e57-b25d-4d40-9314-163ccda3d809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c39f4915-5bb0-4851-b242-e2b5756718c7 tempest-ProjectReaderTests-1853603710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.20a3f042-570c-417a-a302-1a42f65b0841" returned: 0 in 0.407s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:42 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-c39f4915-5bb0-4851-b242-e2b5756718c7 tempest-ProjectReaderTests-1853603710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-597729ed-ea4e-4fa1-91bf-3eac615837f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94391e57-b25d-4d40-9314-163ccda3d809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-66092960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73466a7e-3e83-4cde-b177-35f165fecf94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16d9e4115144c68db4659423a5963a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:43Z,use_quota=True,user_id='b4c31a80b5c54f3eb121e7c39fe61f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (325c441f-84bc-4443-85df-bdd82cff54b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (325c441f-84bc-4443-85df-bdd82cff54b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2494922-d54f-4b14-a5fc-a701846b91ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2494922-d54f-4b14-a5fc-a701846b91ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73466a7e-3e83-4cde-b177-35f165fecf94', 'volume_name': 'volume-73466a7e-3e83-4cde-b177-35f165fecf94', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eebf294-073b-4404-a246-01a348c96d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eebf294-073b-4404-a246-01a348c96d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0246ff1-808d-4593-aa0f-fb6a3e797505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:43 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Volume 73466a7e-3e83-4cde-b177-35f165fecf94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73466a7e-3e83-4cde-b177-35f165fecf94', 'volume_size': 1} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-66092960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73466a7e-3e83-4cde-b177-35f165fecf94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16d9e4115144c68db4659423a5963a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:43Z,use_quota=True,user_id='b4c31a80b5c54f3eb121e7c39fe61f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Creating volume 73466a7e-3e83-4cde-b177-35f165fecf94 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:33:43 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d3f4f1-135c-4376-b33a-1da477594355]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c39f4915-5bb0-4851-b242-e2b5756718c7 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:43 devstack sudo[108867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94 1073741824 Sep 09 18:33:43 devstack sudo[108867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:43 devstack sudo[108868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4 Sep 09 18:33:43 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:43 devstack sudo[108871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:33:43 devstack sudo[108871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:43 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c39f4915-5bb0-4851-b242-e2b5756718c7 tempest-ProjectReaderTests-1853603710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4" returned: 0 in 0.383s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c39f4915-5bb0-4851-b242-e2b5756718c7 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.20a3f042-570c-417a-a302-1a42f65b0841 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:43 devstack sudo[108879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.20a3f042-570c-417a-a302-1a42f65b0841 Sep 09 18:33:43 devstack sudo[108879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:43 devstack sudo[108867]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94 1073741824" returned: 0 in 0.453s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:43 devstack sudo[108871]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.291s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 29 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:43 devstack sudo[108882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94 Sep 09 18:33:43 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:43 devstack sudo[108879]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c39f4915-5bb0-4851-b242-e2b5756718c7 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.20a3f042-570c-417a-a302-1a42f65b0841" returned: 0 in 0.356s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c39f4915-5bb0-4851-b242-e2b5756718c7 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.20a3f042-570c-417a-a302-1a42f65b0841 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:43 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94" returned: 0 in 0.270s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:43 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.20a3f042-570c-417a-a302-1a42f65b0841 Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0246ff1-808d-4593-aa0f-fb6a3e797505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73466a7e-3e83-4cde-b177-35f165fecf94', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:43 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1b3b0a-2ae4-4747-aa81-938103baa324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:43 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Volume volume-73466a7e-3e83-4cde-b177-35f165fecf94 (73466a7e-3e83-4cde-b177-35f165fecf94): created successfully Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e1b3b0a-2ae4-4747-aa81-938103baa324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Flow 'volume_create_manager' (5a5ce360-840f-4c85-bb7e-1923d1eee352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:43 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-4c662321-2e28-4a62-afbc-48ffa6e10795 tempest-ProjectMemberTests-1445315730 None] Created volume successfully. Sep 09 18:33:44 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-c39f4915-5bb0-4851-b242-e2b5756718c7 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4.20a3f042-570c-417a-a302-1a42f65b0841" returned: 0 in 0.252s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c39f4915-5bb0-4851-b242-e2b5756718c7 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-20a3f042-570c-417a-a302-1a42f65b0841" released by "_delete_snapshot" :: held 1.558s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c39f4915-5bb0-4851-b242-e2b5756718c7 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-597729ed-ea4e-4fa1-91bf-3eac615837f4" released by "delete_snapshot" :: held 1.579s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:44 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-c39f4915-5bb0-4851-b242-e2b5756718c7 tempest-ProjectReaderTests-1853603710 None] Created reservations ['e12a3fdb-8d8f-4d9c-9453-de37f1c08ba7', '2d3e534e-cd63-4ba3-bdf4-0b7a7705f1ce', 'c0496061-41e0-45e0-9506-3e239fbcaff8', 'ecc8cd09-054f-48ea-bb65-b2c2af1b8268'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:44 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-c39f4915-5bb0-4851-b242-e2b5756718c7 tempest-ProjectReaderTests-1853603710 None] Delete snapshot completed successfully. Sep 09 18:33:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-c39f4915-5bb0-4851-b242-e2b5756718c7 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-20a3f042-570c-417a-a302-1a42f65b0841-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-421f4d1f-2b0f-427b-80a2-c141dadb1861 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-597729ed-ea4e-4fa1-91bf-3eac615837f4-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-421f4d1f-2b0f-427b-80a2-c141dadb1861 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-597729ed-ea4e-4fa1-91bf-3eac615837f4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-421f4d1f-2b0f-427b-80a2-c141dadb1861 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-quobyte-597729ed-ea4e-4fa1-91bf-3eac615837f4" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:44 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-421f4d1f-2b0f-427b-80a2-c141dadb1861 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-597729ed-ea4e-4fa1-91bf-3eac615837f4" acquired by "delete_volume" :: waited 0.014s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:44 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[496eeb20-c856-43bb-b08b-2c638379d5a5]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:44 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-421f4d1f-2b0f-427b-80a2-c141dadb1861 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:44 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4 Sep 09 18:33:44 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:45 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-421f4d1f-2b0f-427b-80a2-c141dadb1861 tempest-ProjectReaderTests-1853603710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4" returned: 0 in 0.362s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-421f4d1f-2b0f-427b-80a2-c141dadb1861 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:45 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4 Sep 09 18:33:45 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-30d9235b-6430-464c-8a9f-52b0cefad9fc tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-30d9235b-6430-464c-8a9f-52b0cefad9fc tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-30d9235b-6430-464c-8a9f-52b0cefad9fc tempest-ProjectMemberTests-1445315730 None] Creating offline snapshot 03faa1b6-2259-4c24-9f11-6680f7c268fb of volume 73466a7e-3e83-4cde-b177-35f165fecf94 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:33:45 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee8ce19-55dd-4701-a59a-94aa29c38c8d]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-30d9235b-6430-464c-8a9f-52b0cefad9fc tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:45 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-421f4d1f-2b0f-427b-80a2-c141dadb1861 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-597729ed-ea4e-4fa1-91bf-3eac615837f4" returned: 0 in 0.257s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-421f4d1f-2b0f-427b-80a2-c141dadb1861 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-597729ed-ea4e-4fa1-91bf-3eac615837f4" released by "delete_volume" :: held 0.674s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:45 devstack sudo[108898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94 Sep 09 18:33:45 devstack sudo[108898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:45 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-421f4d1f-2b0f-427b-80a2-c141dadb1861 tempest-ProjectReaderTests-1853603710 None] Created reservations ['0235f065-9962-4333-b1c0-72fbe15bf304', '8bd79c82-2fab-4ed9-b870-a07258783485', '07324130-b99b-4a6f-87c0-44390be9f6a7', 'e17fdc0a-1f18-4833-80f2-65cf7d7022ef'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-421f4d1f-2b0f-427b-80a2-c141dadb1861 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-421f4d1f-2b0f-427b-80a2-c141dadb1861 tempest-ProjectReaderTests-1853603710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-421f4d1f-2b0f-427b-80a2-c141dadb1861 tempest-ProjectReaderTests-1853603710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:45 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-421f4d1f-2b0f-427b-80a2-c141dadb1861 tempest-ProjectReaderTests-1853603710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-421f4d1f-2b0f-427b-80a2-c141dadb1861 tempest-ProjectReaderTests-1853603710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-421f4d1f-2b0f-427b-80a2-c141dadb1861 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:45 devstack sudo[108901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:33:45 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:45 devstack sudo[108898]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-30d9235b-6430-464c-8a9f-52b0cefad9fc tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94" returned: 0 in 0.368s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-30d9235b-6430-464c-8a9f-52b0cefad9fc tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.03faa1b6-2259-4c24-9f11-6680f7c268fb 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:45 devstack sudo[108906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.03faa1b6-2259-4c24-9f11-6680f7c268fb 1G Sep 09 18:33:45 devstack sudo[108906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:45 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:45 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-421f4d1f-2b0f-427b-80a2-c141dadb1861 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.248s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:45 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-421f4d1f-2b0f-427b-80a2-c141dadb1861 tempest-ProjectReaderTests-1853603710 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:33:45 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-421f4d1f-2b0f-427b-80a2-c141dadb1861 tempest-ProjectReaderTests-1853603710 None] Deleted volume successfully. Sep 09 18:33:45 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-421f4d1f-2b0f-427b-80a2-c141dadb1861 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-597729ed-ea4e-4fa1-91bf-3eac615837f4-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:46 devstack sudo[108906]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-30d9235b-6430-464c-8a9f-52b0cefad9fc tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.03faa1b6-2259-4c24-9f11-6680f7c268fb 1G" returned: 0 in 0.448s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-30d9235b-6430-464c-8a9f-52b0cefad9fc tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73466a7e-3e83-4cde-b177-35f165fecf94 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.03faa1b6-2259-4c24-9f11-6680f7c268fb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:46 devstack sudo[108913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73466a7e-3e83-4cde-b177-35f165fecf94 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.03faa1b6-2259-4c24-9f11-6680f7c268fb Sep 09 18:33:46 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:46 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=204,cinder:INSERT=77,cinder:UPDATE=236,cinder:DELETE=17 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:33:46 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:33:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Flow 'volume_create_manager' (c9d64fad-757d-40ed-8add-bc6173fdcbee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfaafc4-3382-426b-add7-faf5b34b2189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdfaafc4-3382-426b-add7-faf5b34b2189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-423618705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ed850e-eff4-4660-8dcf-82adcf424d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4e18d007b14019a7b42dce4232e50f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:46Z,use_quota=True,user_id='df73eac20f1e49dc9bbdd2f7224b6fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a50082-0dc9-440d-9916-610fbdf38952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a50082-0dc9-440d-9916-610fbdf38952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1cd713-4dd4-41c0-9a0d-66d757cd9181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d1cd713-4dd4-41c0-9a0d-66d757cd9181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70ed850e-eff4-4660-8dcf-82adcf424d31', 'volume_name': 'volume-70ed850e-eff4-4660-8dcf-82adcf424d31', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3220df-2986-45d6-852c-805d77b83e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3220df-2986-45d6-852c-805d77b83e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:46 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c7fabb5-259e-4be2-ba95-c6f9060ec3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:46 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Volume 70ed850e-eff4-4660-8dcf-82adcf424d31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70ed850e-eff4-4660-8dcf-82adcf424d31', 'volume_size': 1} Sep 09 18:33:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:46 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-30d9235b-6430-464c-8a9f-52b0cefad9fc tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73466a7e-3e83-4cde-b177-35f165fecf94 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.03faa1b6-2259-4c24-9f11-6680f7c268fb" returned: 0 in 0.311s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:46 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-30d9235b-6430-464c-8a9f-52b0cefad9fc tempest-ProjectMemberTests-1445315730 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.03faa1b6-2259-4c24-9f11-6680f7c268fb is being set with open permissions: ugo+rw Sep 09 18:33:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-30d9235b-6430-464c-8a9f-52b0cefad9fc tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.03faa1b6-2259-4c24-9f11-6680f7c268fb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:46 devstack sudo[108919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.03faa1b6-2259-4c24-9f11-6680f7c268fb Sep 09 18:33:46 devstack sudo[108919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:46 devstack sudo[108919]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-30d9235b-6430-464c-8a9f-52b0cefad9fc tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.03faa1b6-2259-4c24-9f11-6680f7c268fb" returned: 0 in 0.246s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-30d9235b-6430-464c-8a9f-52b0cefad9fc tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:46 devstack sudo[108922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.info Sep 09 18:33:46 devstack sudo[108922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:46 devstack sudo[108922]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-30d9235b-6430-464c-8a9f-52b0cefad9fc tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.info" returned: 0 in 0.246s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:46 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-30d9235b-6430-464c-8a9f-52b0cefad9fc tempest-ProjectMemberTests-1445315730 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.info is being set with open permissions: ugo+rw Sep 09 18:33:46 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-30d9235b-6430-464c-8a9f-52b0cefad9fc tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:46 devstack sudo[108925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.info Sep 09 18:33:46 devstack sudo[108925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:47 devstack sudo[108925]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-30d9235b-6430-464c-8a9f-52b0cefad9fc tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.info" returned: 0 in 0.237s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-30d9235b-6430-464c-8a9f-52b0cefad9fc tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.930s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.781s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-423618705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ed850e-eff4-4660-8dcf-82adcf424d31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4e18d007b14019a7b42dce4232e50f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:46Z,use_quota=True,user_id='df73eac20f1e49dc9bbdd2f7224b6fbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:33:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Creating volume 70ed850e-eff4-4660-8dcf-82adcf424d31 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:33:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:33:47 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:33:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:47 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:UPDATE=268,cinder:SELECT=184,cinder:INSERT=59,cinder:DELETE=23 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:33:47 devstack sudo[108928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31 1073741824 Sep 09 18:33:47 devstack sudo[108928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:47 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-30d9235b-6430-464c-8a9f-52b0cefad9fc tempest-ProjectMemberTests-1445315730 None] Create snapshot completed successfully Sep 09 18:33:47 devstack sudo[108928]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31 1073741824" returned: 0 in 0.414s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:47 devstack sudo[108933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31 Sep 09 18:33:47 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:47 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31" returned: 0 in 0.246s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:47 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:33:47 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c7fabb5-259e-4be2-ba95-c6f9060ec3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ed850e-eff4-4660-8dcf-82adcf424d31', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548328ee-8072-4c0c-b9b2-da2d44e5f28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:47 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Volume volume-70ed850e-eff4-4660-8dcf-82adcf424d31 (70ed850e-eff4-4660-8dcf-82adcf424d31): created successfully Sep 09 18:33:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548328ee-8072-4c0c-b9b2-da2d44e5f28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:47 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Flow 'volume_create_manager' (c9d64fad-757d-40ed-8add-bc6173fdcbee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:47 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-7cc5e4f4-fcc3-486d-a924-7cd24b75bbbb tempest-ProjectReaderTests-1853603710 None] Created volume successfully. Sep 09 18:33:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-25c90da6-f8ea-440c-ab58-0bd10e351518 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-03faa1b6-2259-4c24-9f11-6680f7c268fb-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-25c90da6-f8ea-440c-ab58-0bd10e351518 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-03faa1b6-2259-4c24-9f11-6680f7c268fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-25c90da6-f8ea-440c-ab58-0bd10e351518 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-73466a7e-3e83-4cde-b177-35f165fecf94" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-25c90da6-f8ea-440c-ab58-0bd10e351518 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-73466a7e-3e83-4cde-b177-35f165fecf94" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-25c90da6-f8ea-440c-ab58-0bd10e351518 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-03faa1b6-2259-4c24-9f11-6680f7c268fb" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:48 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-25c90da6-f8ea-440c-ab58-0bd10e351518 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-03faa1b6-2259-4c24-9f11-6680f7c268fb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-25c90da6-f8ea-440c-ab58-0bd10e351518 tempest-ProjectMemberTests-1445315730 None] Deleting offline snapshot 03faa1b6-2259-4c24-9f11-6680f7c268fb of volume 73466a7e-3e83-4cde-b177-35f165fecf94 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:33:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-25c90da6-f8ea-440c-ab58-0bd10e351518 tempest-ProjectMemberTests-1445315730 None] snapshot_file for this snap is: volume-73466a7e-3e83-4cde-b177-35f165fecf94.03faa1b6-2259-4c24-9f11-6680f7c268fb {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:33:48 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b302348-3be9-4fbc-9c19-219df8815f39]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-25c90da6-f8ea-440c-ab58-0bd10e351518 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.03faa1b6-2259-4c24-9f11-6680f7c268fb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ed15be33-1187-4094-9fa1-a5400f356e36 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ed15be33-1187-4094-9fa1-a5400f356e36 tempest-ProjectReaderTests-1853603710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-ed15be33-1187-4094-9fa1-a5400f356e36 tempest-ProjectReaderTests-1853603710 None] Creating offline snapshot eb81980a-e4da-4f6d-937c-3a6306fc0428 of volume 70ed850e-eff4-4660-8dcf-82adcf424d31 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:33:48 devstack sudo[108936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.03faa1b6-2259-4c24-9f11-6680f7c268fb Sep 09 18:33:48 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec46544-c65f-45da-af66-35c7e14b7663]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed15be33-1187-4094-9fa1-a5400f356e36 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:48 devstack sudo[108936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:48 devstack sudo[108938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31 Sep 09 18:33:48 devstack sudo[108938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:48 devstack sudo[108936]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-25c90da6-f8ea-440c-ab58-0bd10e351518 tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.03faa1b6-2259-4c24-9f11-6680f7c268fb" returned: 0 in 0.368s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:48 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-25c90da6-f8ea-440c-ab58-0bd10e351518 tempest-ProjectMemberTests-1445315730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73466a7e-3e83-4cde-b177-35f165fecf94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:33:48 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[db322c08-aff4-4055-abfb-76e33e98d4eb]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-25c90da6-f8ea-440c-ab58-0bd10e351518 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:48 devstack sudo[108938]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed15be33-1187-4094-9fa1-a5400f356e36 tempest-ProjectReaderTests-1853603710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31" returned: 0 in 0.365s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:48 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed15be33-1187-4094-9fa1-a5400f356e36 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.eb81980a-e4da-4f6d-937c-3a6306fc0428 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:48 devstack sudo[108943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94 Sep 09 18:33:48 devstack sudo[108943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:48 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.eb81980a-e4da-4f6d-937c-3a6306fc0428 1G Sep 09 18:33:48 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:49 devstack sudo[108943]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-25c90da6-f8ea-440c-ab58-0bd10e351518 tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94" returned: 0 in 0.361s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-25c90da6-f8ea-440c-ab58-0bd10e351518 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.03faa1b6-2259-4c24-9f11-6680f7c268fb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:49 devstack sudo[108956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.03faa1b6-2259-4c24-9f11-6680f7c268fb Sep 09 18:33:49 devstack sudo[108956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:49 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed15be33-1187-4094-9fa1-a5400f356e36 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.eb81980a-e4da-4f6d-937c-3a6306fc0428 1G" returned: 0 in 0.392s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed15be33-1187-4094-9fa1-a5400f356e36 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ed850e-eff4-4660-8dcf-82adcf424d31 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.eb81980a-e4da-4f6d-937c-3a6306fc0428 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:49 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ed850e-eff4-4660-8dcf-82adcf424d31 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.eb81980a-e4da-4f6d-937c-3a6306fc0428 Sep 09 18:33:49 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:49 devstack sudo[108956]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-25c90da6-f8ea-440c-ab58-0bd10e351518 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.03faa1b6-2259-4c24-9f11-6680f7c268fb" returned: 0 in 0.340s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-25c90da6-f8ea-440c-ab58-0bd10e351518 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.03faa1b6-2259-4c24-9f11-6680f7c268fb {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:49 devstack sudo[108965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.03faa1b6-2259-4c24-9f11-6680f7c268fb Sep 09 18:33:49 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:49 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed15be33-1187-4094-9fa1-a5400f356e36 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ed850e-eff4-4660-8dcf-82adcf424d31 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.eb81980a-e4da-4f6d-937c-3a6306fc0428" returned: 0 in 0.289s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:49 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-ed15be33-1187-4094-9fa1-a5400f356e36 tempest-ProjectReaderTests-1853603710 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.eb81980a-e4da-4f6d-937c-3a6306fc0428 is being set with open permissions: ugo+rw Sep 09 18:33:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed15be33-1187-4094-9fa1-a5400f356e36 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.eb81980a-e4da-4f6d-937c-3a6306fc0428 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:49 devstack sudo[108968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.eb81980a-e4da-4f6d-937c-3a6306fc0428 Sep 09 18:33:49 devstack sudo[108968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:49 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-25c90da6-f8ea-440c-ab58-0bd10e351518 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94.03faa1b6-2259-4c24-9f11-6680f7c268fb" returned: 0 in 0.244s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-25c90da6-f8ea-440c-ab58-0bd10e351518 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-03faa1b6-2259-4c24-9f11-6680f7c268fb" released by "_delete_snapshot" :: held 1.401s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-25c90da6-f8ea-440c-ab58-0bd10e351518 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-73466a7e-3e83-4cde-b177-35f165fecf94" released by "delete_snapshot" :: held 1.426s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:49 devstack sudo[108968]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed15be33-1187-4094-9fa1-a5400f356e36 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.eb81980a-e4da-4f6d-937c-3a6306fc0428" returned: 0 in 0.257s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:49 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-25c90da6-f8ea-440c-ab58-0bd10e351518 tempest-ProjectMemberTests-1445315730 None] Created reservations ['462c1ee4-318a-4064-9501-fdca6c065c1f', '5916b8d6-2d98-4222-97a3-87f1f1d49d27', '010b0e48-f3e0-4c82-b375-61729f129379', '54540d64-7543-4d33-bf94-916064023186'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:49 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed15be33-1187-4094-9fa1-a5400f356e36 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:49 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.info Sep 09 18:33:49 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:49 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-25c90da6-f8ea-440c-ab58-0bd10e351518 tempest-ProjectMemberTests-1445315730 None] Delete snapshot completed successfully. Sep 09 18:33:49 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-25c90da6-f8ea-440c-ab58-0bd10e351518 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-03faa1b6-2259-4c24-9f11-6680f7c268fb-delete_snapshot" released by "delete_snapshot" :: held 1.601s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:50 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed15be33-1187-4094-9fa1-a5400f356e36 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.info" returned: 0 in 0.283s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:50 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-ed15be33-1187-4094-9fa1-a5400f356e36 tempest-ProjectReaderTests-1853603710 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.info is being set with open permissions: ugo+rw Sep 09 18:33:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed15be33-1187-4094-9fa1-a5400f356e36 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:50 devstack sudo[108975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.info Sep 09 18:33:50 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:50 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ed15be33-1187-4094-9fa1-a5400f356e36 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.info" returned: 0 in 0.233s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ed15be33-1187-4094-9fa1-a5400f356e36 tempest-ProjectReaderTests-1853603710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.907s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:50 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ed15be33-1187-4094-9fa1-a5400f356e36 tempest-ProjectReaderTests-1853603710 None] Create snapshot completed successfully Sep 09 18:33:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d6ba78b4-4087-45d6-bea6-9c011545b830 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-73466a7e-3e83-4cde-b177-35f165fecf94-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d6ba78b4-4087-45d6-bea6-9c011545b830 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-73466a7e-3e83-4cde-b177-35f165fecf94-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d6ba78b4-4087-45d6-bea6-9c011545b830 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-73466a7e-3e83-4cde-b177-35f165fecf94" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d6ba78b4-4087-45d6-bea6-9c011545b830 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-73466a7e-3e83-4cde-b177-35f165fecf94" acquired by "delete_volume" :: waited 0.014s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:50 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[2410aa7c-b0a4-4479-8c08-89c3321ecfa1]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d6ba78b4-4087-45d6-bea6-9c011545b830 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-eb6ba754-f693-45fb-9b0b-91fc6d03b4e4 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-eb81980a-e4da-4f6d-937c-3a6306fc0428-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-eb6ba754-f693-45fb-9b0b-91fc6d03b4e4 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-eb81980a-e4da-4f6d-937c-3a6306fc0428-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-eb6ba754-f693-45fb-9b0b-91fc6d03b4e4 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-quobyte-70ed850e-eff4-4660-8dcf-82adcf424d31" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-eb6ba754-f693-45fb-9b0b-91fc6d03b4e4 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-70ed850e-eff4-4660-8dcf-82adcf424d31" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-eb6ba754-f693-45fb-9b0b-91fc6d03b4e4 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-quobyte-eb81980a-e4da-4f6d-937c-3a6306fc0428" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:50 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-eb6ba754-f693-45fb-9b0b-91fc6d03b4e4 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-eb81980a-e4da-4f6d-937c-3a6306fc0428" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-eb6ba754-f693-45fb-9b0b-91fc6d03b4e4 tempest-ProjectReaderTests-1853603710 None] Deleting offline snapshot eb81980a-e4da-4f6d-937c-3a6306fc0428 of volume 70ed850e-eff4-4660-8dcf-82adcf424d31 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:33:50 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-eb6ba754-f693-45fb-9b0b-91fc6d03b4e4 tempest-ProjectReaderTests-1853603710 None] snapshot_file for this snap is: volume-70ed850e-eff4-4660-8dcf-82adcf424d31.eb81980a-e4da-4f6d-937c-3a6306fc0428 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:33:50 devstack sudo[108978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94 Sep 09 18:33:50 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:50 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[df88a447-5e89-46c5-980c-2751c97fe0f9]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eb6ba754-f693-45fb-9b0b-91fc6d03b4e4 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.eb81980a-e4da-4f6d-937c-3a6306fc0428 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:50 devstack sudo[108980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.eb81980a-e4da-4f6d-937c-3a6306fc0428 Sep 09 18:33:50 devstack sudo[108980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:50 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d6ba78b4-4087-45d6-bea6-9c011545b830 tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94" returned: 0 in 0.389s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:50 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d6ba78b4-4087-45d6-bea6-9c011545b830 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:51 devstack sudo[108985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94 Sep 09 18:33:51 devstack sudo[108985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:51 devstack sudo[108980]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eb6ba754-f693-45fb-9b0b-91fc6d03b4e4 tempest-ProjectReaderTests-1853603710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.eb81980a-e4da-4f6d-937c-3a6306fc0428" returned: 0 in 0.375s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-eb6ba754-f693-45fb-9b0b-91fc6d03b4e4 tempest-ProjectReaderTests-1853603710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70ed850e-eff4-4660-8dcf-82adcf424d31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:33:51 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa57768-952a-42dd-9828-129be84029f1]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eb6ba754-f693-45fb-9b0b-91fc6d03b4e4 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:51 devstack sudo[108985]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:51 devstack sudo[108990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31 Sep 09 18:33:51 devstack sudo[108990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d6ba78b4-4087-45d6-bea6-9c011545b830 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-73466a7e-3e83-4cde-b177-35f165fecf94" returned: 0 in 0.262s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d6ba78b4-4087-45d6-bea6-9c011545b830 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-73466a7e-3e83-4cde-b177-35f165fecf94" released by "delete_volume" :: held 0.711s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:51 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-d6ba78b4-4087-45d6-bea6-9c011545b830 tempest-ProjectMemberTests-1445315730 None] Created reservations ['36318af7-53ed-40b3-bd07-b2fac15a416a', '21fa2f35-9db7-47b3-bb53-608c1741280f', 'e0a2d11e-d277-406b-8019-d214bc9cf79f', 'b86691a3-1ebf-4fa7-bb1d-c11e39efd1ed'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d6ba78b4-4087-45d6-bea6-9c011545b830 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d6ba78b4-4087-45d6-bea6-9c011545b830 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d6ba78b4-4087-45d6-bea6-9c011545b830 tempest-ProjectMemberTests-1445315730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:51 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d6ba78b4-4087-45d6-bea6-9c011545b830 tempest-ProjectMemberTests-1445315730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d6ba78b4-4087-45d6-bea6-9c011545b830 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d6ba78b4-4087-45d6-bea6-9c011545b830 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:51 devstack sudo[108993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:33:51 devstack sudo[108993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:51 devstack sudo[108990]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eb6ba754-f693-45fb-9b0b-91fc6d03b4e4 tempest-ProjectReaderTests-1853603710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31" returned: 0 in 0.369s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eb6ba754-f693-45fb-9b0b-91fc6d03b4e4 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.eb81980a-e4da-4f6d-937c-3a6306fc0428 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:51 devstack sudo[108998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.eb81980a-e4da-4f6d-937c-3a6306fc0428 Sep 09 18:33:51 devstack sudo[108998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:51 devstack sudo[108993]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d6ba78b4-4087-45d6-bea6-9c011545b830 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.269s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:51 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-d6ba78b4-4087-45d6-bea6-9c011545b830 tempest-ProjectMemberTests-1445315730 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:33:51 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d6ba78b4-4087-45d6-bea6-9c011545b830 tempest-ProjectMemberTests-1445315730 None] Deleted volume successfully. Sep 09 18:33:51 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-d6ba78b4-4087-45d6-bea6-9c011545b830 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-73466a7e-3e83-4cde-b177-35f165fecf94-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:51 devstack sudo[108998]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eb6ba754-f693-45fb-9b0b-91fc6d03b4e4 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.eb81980a-e4da-4f6d-937c-3a6306fc0428" returned: 0 in 0.363s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:51 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eb6ba754-f693-45fb-9b0b-91fc6d03b4e4 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.eb81980a-e4da-4f6d-937c-3a6306fc0428 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:51 devstack sudo[109004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.eb81980a-e4da-4f6d-937c-3a6306fc0428 Sep 09 18:33:51 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Flow 'volume_create_manager' (29c0ef67-cfc8-4f46-aea2-43d080593b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:52 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561915bd-4553-4532-945a-8404db66e28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-eb6ba754-f693-45fb-9b0b-91fc6d03b4e4 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31.eb81980a-e4da-4f6d-937c-3a6306fc0428" returned: 0 in 0.292s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (561915bd-4553-4532-945a-8404db66e28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1390166445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e674fe73-11ee-4288-85bd-29d904fc39ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16d9e4115144c68db4659423a5963a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:52Z,use_quota=True,user_id='b4c31a80b5c54f3eb121e7c39fe61f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a261fdf1-f358-4efa-a840-3b435f18c0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a261fdf1-f358-4efa-a840-3b435f18c0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959243e1-f7a5-4450-9d2c-30ce2afea63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959243e1-f7a5-4450-9d2c-30ce2afea63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e674fe73-11ee-4288-85bd-29d904fc39ab', 'volume_name': 'volume-e674fe73-11ee-4288-85bd-29d904fc39ab', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4499893-0b4a-44a2-9c84-14e12fe25793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4499893-0b4a-44a2-9c84-14e12fe25793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ed0198-115f-46b0-8f72-4eca9acef807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:52 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Volume e674fe73-11ee-4288-85bd-29d904fc39ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e674fe73-11ee-4288-85bd-29d904fc39ab', 'volume_size': 1} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1390166445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e674fe73-11ee-4288-85bd-29d904fc39ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16d9e4115144c68db4659423a5963a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:52Z,use_quota=True,user_id='b4c31a80b5c54f3eb121e7c39fe61f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Creating volume e674fe73-11ee-4288-85bd-29d904fc39ab {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:33:52 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-eb6ba754-f693-45fb-9b0b-91fc6d03b4e4 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-eb81980a-e4da-4f6d-937c-3a6306fc0428" released by "_delete_snapshot" :: held 1.549s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-eb6ba754-f693-45fb-9b0b-91fc6d03b4e4 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-70ed850e-eff4-4660-8dcf-82adcf424d31" released by "delete_snapshot" :: held 1.576s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:52 devstack sudo[109007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab 1073741824 Sep 09 18:33:52 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-eb6ba754-f693-45fb-9b0b-91fc6d03b4e4 tempest-ProjectReaderTests-1853603710 None] Created reservations ['6e969e0f-60bb-43c5-8a1a-09f9b37e9ced', '1cc884f2-55bc-4574-be44-da514b8becf5', 'decc27d2-dfc1-4dca-911c-76e59988f8be', '3044881a-0679-4bb4-abab-18d8d2594410'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:52 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-eb6ba754-f693-45fb-9b0b-91fc6d03b4e4 tempest-ProjectReaderTests-1853603710 None] Delete snapshot completed successfully. Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-eb6ba754-f693-45fb-9b0b-91fc6d03b4e4 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-eb81980a-e4da-4f6d-937c-3a6306fc0428-delete_snapshot" released by "delete_snapshot" :: held 1.721s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:52 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab 1073741824" returned: 0 in 0.398s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:52 devstack sudo[109013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab Sep 09 18:33:52 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e883a631-6fb1-42e9-ba90-bade52540f62 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-70ed850e-eff4-4660-8dcf-82adcf424d31-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e883a631-6fb1-42e9-ba90-bade52540f62 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-70ed850e-eff4-4660-8dcf-82adcf424d31-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e883a631-6fb1-42e9-ba90-bade52540f62 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "cinder-quobyte-70ed850e-eff4-4660-8dcf-82adcf424d31" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e883a631-6fb1-42e9-ba90-bade52540f62 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-70ed850e-eff4-4660-8dcf-82adcf424d31" acquired by "delete_volume" :: waited 0.015s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b25c04-13de-4cd5-b69f-e98cbde547a8]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e883a631-6fb1-42e9-ba90-bade52540f62 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:52 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab" returned: 0 in 0.292s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26ed0198-115f-46b0-8f72-4eca9acef807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e674fe73-11ee-4288-85bd-29d904fc39ab', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:52 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a0fdada-c0c8-4861-8c77-e3fb931ee6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:53 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Volume volume-e674fe73-11ee-4288-85bd-29d904fc39ab (e674fe73-11ee-4288-85bd-29d904fc39ab): created successfully Sep 09 18:33:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a0fdada-c0c8-4861-8c77-e3fb931ee6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:53 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Flow 'volume_create_manager' (29c0ef67-cfc8-4f46-aea2-43d080593b44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:53 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-a1a3df68-7553-4fe9-b3f4-29585c1343a9 tempest-ProjectMemberTests-1445315730 None] Created volume successfully. Sep 09 18:33:53 devstack sudo[109016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31 Sep 09 18:33:53 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1bc54cc5-540c-4b8b-8f11-60523d769ca9 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1bc54cc5-540c-4b8b-8f11-60523d769ca9 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-1bc54cc5-540c-4b8b-8f11-60523d769ca9 tempest-ProjectMemberTests-1445315730 None] Creating offline snapshot 33ab5e02-5260-4c3f-8084-228d1a57944a of volume e674fe73-11ee-4288-85bd-29d904fc39ab {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:33:53 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[7835761b-6645-473f-8e2d-16850db100b5]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1bc54cc5-540c-4b8b-8f11-60523d769ca9 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:53 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e883a631-6fb1-42e9-ba90-bade52540f62 tempest-ProjectReaderTests-1853603710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31" returned: 0 in 0.407s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e883a631-6fb1-42e9-ba90-bade52540f62 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:53 devstack sudo[109022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31 Sep 09 18:33:53 devstack sudo[109022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:53 devstack sudo[109021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab Sep 09 18:33:53 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:53 devstack sudo[109022]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e883a631-6fb1-42e9-ba90-bade52540f62 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-70ed850e-eff4-4660-8dcf-82adcf424d31" returned: 0 in 0.249s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:53 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e883a631-6fb1-42e9-ba90-bade52540f62 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-quobyte-70ed850e-eff4-4660-8dcf-82adcf424d31" released by "delete_volume" :: held 0.720s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:53 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-e883a631-6fb1-42e9-ba90-bade52540f62 tempest-ProjectReaderTests-1853603710 None] Created reservations ['da334f05-976e-4b2c-be0f-60e461f96d0d', '8d5d90d0-b2bc-46d7-bf89-64249be4831a', '22ce37be-d005-4ff0-812d-24187a42397f', '7d3210fa-4e72-4e8d-9ec0-6ca56a5a7290'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:53 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1bc54cc5-540c-4b8b-8f11-60523d769ca9 tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab" returned: 0 in 0.368s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1bc54cc5-540c-4b8b-8f11-60523d769ca9 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.33ab5e02-5260-4c3f-8084-228d1a57944a 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:53 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.33ab5e02-5260-4c3f-8084-228d1a57944a 1G Sep 09 18:33:53 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e883a631-6fb1-42e9-ba90-bade52540f62 tempest-ProjectReaderTests-1853603710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e883a631-6fb1-42e9-ba90-bade52540f62 tempest-ProjectReaderTests-1853603710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e883a631-6fb1-42e9-ba90-bade52540f62 tempest-ProjectReaderTests-1853603710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:53 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e883a631-6fb1-42e9-ba90-bade52540f62 tempest-ProjectReaderTests-1853603710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e883a631-6fb1-42e9-ba90-bade52540f62 tempest-ProjectReaderTests-1853603710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:53 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e883a631-6fb1-42e9-ba90-bade52540f62 tempest-ProjectReaderTests-1853603710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:53 devstack sudo[109031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:33:53 devstack sudo[109031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:54 devstack sudo[109031]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e883a631-6fb1-42e9-ba90-bade52540f62 tempest-ProjectReaderTests-1853603710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.262s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:54 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-e883a631-6fb1-42e9-ba90-bade52540f62 tempest-ProjectReaderTests-1853603710 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:33:54 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-e883a631-6fb1-42e9-ba90-bade52540f62 tempest-ProjectReaderTests-1853603710 None] Deleted volume successfully. Sep 09 18:33:54 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-e883a631-6fb1-42e9-ba90-bade52540f62 tempest-ProjectReaderTests-1853603710 None] Lock "cinder-70ed850e-eff4-4660-8dcf-82adcf424d31-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:54 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1bc54cc5-540c-4b8b-8f11-60523d769ca9 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.33ab5e02-5260-4c3f-8084-228d1a57944a 1G" returned: 0 in 0.441s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1bc54cc5-540c-4b8b-8f11-60523d769ca9 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e674fe73-11ee-4288-85bd-29d904fc39ab -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.33ab5e02-5260-4c3f-8084-228d1a57944a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:54 devstack sudo[109037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e674fe73-11ee-4288-85bd-29d904fc39ab -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.33ab5e02-5260-4c3f-8084-228d1a57944a Sep 09 18:33:54 devstack sudo[109037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:54 devstack sudo[109037]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1bc54cc5-540c-4b8b-8f11-60523d769ca9 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e674fe73-11ee-4288-85bd-29d904fc39ab -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.33ab5e02-5260-4c3f-8084-228d1a57944a" returned: 0 in 0.297s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:54 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-1bc54cc5-540c-4b8b-8f11-60523d769ca9 tempest-ProjectMemberTests-1445315730 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.33ab5e02-5260-4c3f-8084-228d1a57944a is being set with open permissions: ugo+rw Sep 09 18:33:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1bc54cc5-540c-4b8b-8f11-60523d769ca9 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.33ab5e02-5260-4c3f-8084-228d1a57944a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:54 devstack sudo[109042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.33ab5e02-5260-4c3f-8084-228d1a57944a Sep 09 18:33:54 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:54 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1bc54cc5-540c-4b8b-8f11-60523d769ca9 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.33ab5e02-5260-4c3f-8084-228d1a57944a" returned: 0 in 0.257s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:54 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1bc54cc5-540c-4b8b-8f11-60523d769ca9 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:54 devstack sudo[109045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.info Sep 09 18:33:54 devstack sudo[109045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:55 devstack sudo[109045]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1bc54cc5-540c-4b8b-8f11-60523d769ca9 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.info" returned: 0 in 0.289s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:55 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-1bc54cc5-540c-4b8b-8f11-60523d769ca9 tempest-ProjectMemberTests-1445315730 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.info is being set with open permissions: ugo+rw Sep 09 18:33:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1bc54cc5-540c-4b8b-8f11-60523d769ca9 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:55 devstack sudo[109048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.info Sep 09 18:33:55 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:55 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1bc54cc5-540c-4b8b-8f11-60523d769ca9 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.info" returned: 0 in 0.241s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1bc54cc5-540c-4b8b-8f11-60523d769ca9 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.976s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:55 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-1bc54cc5-540c-4b8b-8f11-60523d769ca9 tempest-ProjectMemberTests-1445315730 None] Create snapshot completed successfully Sep 09 18:33:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-84d41a93-88ff-4e35-8d5f-660a51152baf tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-33ab5e02-5260-4c3f-8084-228d1a57944a-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-84d41a93-88ff-4e35-8d5f-660a51152baf tempest-ProjectMemberTests-1445315730 None] Lock "cinder-33ab5e02-5260-4c3f-8084-228d1a57944a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-84d41a93-88ff-4e35-8d5f-660a51152baf tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-e674fe73-11ee-4288-85bd-29d904fc39ab" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-84d41a93-88ff-4e35-8d5f-660a51152baf tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-e674fe73-11ee-4288-85bd-29d904fc39ab" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-84d41a93-88ff-4e35-8d5f-660a51152baf tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-33ab5e02-5260-4c3f-8084-228d1a57944a" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:55 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-84d41a93-88ff-4e35-8d5f-660a51152baf tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-33ab5e02-5260-4c3f-8084-228d1a57944a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:55 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-84d41a93-88ff-4e35-8d5f-660a51152baf tempest-ProjectMemberTests-1445315730 None] Deleting offline snapshot 33ab5e02-5260-4c3f-8084-228d1a57944a of volume e674fe73-11ee-4288-85bd-29d904fc39ab {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:33:55 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-84d41a93-88ff-4e35-8d5f-660a51152baf tempest-ProjectMemberTests-1445315730 None] snapshot_file for this snap is: volume-e674fe73-11ee-4288-85bd-29d904fc39ab.33ab5e02-5260-4c3f-8084-228d1a57944a {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:33:55 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[549ce052-285e-4056-bf51-b5d7e67fcd4d]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-84d41a93-88ff-4e35-8d5f-660a51152baf tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.33ab5e02-5260-4c3f-8084-228d1a57944a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:55 devstack sudo[109051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.33ab5e02-5260-4c3f-8084-228d1a57944a Sep 09 18:33:55 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:55 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-84d41a93-88ff-4e35-8d5f-660a51152baf tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.33ab5e02-5260-4c3f-8084-228d1a57944a" returned: 0 in 0.376s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:55 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-84d41a93-88ff-4e35-8d5f-660a51152baf tempest-ProjectMemberTests-1445315730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e674fe73-11ee-4288-85bd-29d904fc39ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:33:55 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[6141fca5-48b7-4cd0-a407-4cd3c8beb645]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:55 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-84d41a93-88ff-4e35-8d5f-660a51152baf tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:56 devstack sudo[109056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab Sep 09 18:33:56 devstack sudo[109056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:56 devstack sudo[109056]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-84d41a93-88ff-4e35-8d5f-660a51152baf tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab" returned: 0 in 0.338s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-84d41a93-88ff-4e35-8d5f-660a51152baf tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.33ab5e02-5260-4c3f-8084-228d1a57944a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:56 devstack sudo[109062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.33ab5e02-5260-4c3f-8084-228d1a57944a Sep 09 18:33:56 devstack sudo[109062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:56 devstack sudo[109062]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-84d41a93-88ff-4e35-8d5f-660a51152baf tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.33ab5e02-5260-4c3f-8084-228d1a57944a" returned: 0 in 0.340s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-84d41a93-88ff-4e35-8d5f-660a51152baf tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.33ab5e02-5260-4c3f-8084-228d1a57944a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:56 devstack sudo[109067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.33ab5e02-5260-4c3f-8084-228d1a57944a Sep 09 18:33:56 devstack sudo[109067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:56 devstack sudo[109067]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:56 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-84d41a93-88ff-4e35-8d5f-660a51152baf tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab.33ab5e02-5260-4c3f-8084-228d1a57944a" returned: 0 in 0.235s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:56 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-84d41a93-88ff-4e35-8d5f-660a51152baf tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-33ab5e02-5260-4c3f-8084-228d1a57944a" released by "_delete_snapshot" :: held 1.374s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:56 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-84d41a93-88ff-4e35-8d5f-660a51152baf tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-e674fe73-11ee-4288-85bd-29d904fc39ab" released by "delete_snapshot" :: held 1.400s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:56 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-84d41a93-88ff-4e35-8d5f-660a51152baf tempest-ProjectMemberTests-1445315730 None] Created reservations ['56fff3c7-ff42-4a36-b628-724884341ee9', 'e48a6844-4d94-4aff-8e26-e3dc664fb703', 'e3e1bf72-30bb-4c07-b3b2-80ea870ab85b', '66cb43fc-294a-4353-a003-f4fc9479ab54'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:57 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-84d41a93-88ff-4e35-8d5f-660a51152baf tempest-ProjectMemberTests-1445315730 None] Delete snapshot completed successfully. Sep 09 18:33:57 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-84d41a93-88ff-4e35-8d5f-660a51152baf tempest-ProjectMemberTests-1445315730 None] Lock "cinder-33ab5e02-5260-4c3f-8084-228d1a57944a-delete_snapshot" released by "delete_snapshot" :: held 1.528s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:57 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-097b8fc7-4909-4a08-aadd-3b7ea676114e tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-e674fe73-11ee-4288-85bd-29d904fc39ab-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:57 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-097b8fc7-4909-4a08-aadd-3b7ea676114e tempest-ProjectMemberTests-1445315730 None] Lock "cinder-e674fe73-11ee-4288-85bd-29d904fc39ab-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:57 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-097b8fc7-4909-4a08-aadd-3b7ea676114e tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-e674fe73-11ee-4288-85bd-29d904fc39ab" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:33:57 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-097b8fc7-4909-4a08-aadd-3b7ea676114e tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-e674fe73-11ee-4288-85bd-29d904fc39ab" acquired by "delete_volume" :: waited 0.013s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:33:57 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ef5b68-31f8-4841-b0a9-49608a4c6711]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:33:57 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-097b8fc7-4909-4a08-aadd-3b7ea676114e tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:57 devstack sudo[109070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab Sep 09 18:33:57 devstack sudo[109070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:58 devstack sudo[109070]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-097b8fc7-4909-4a08-aadd-3b7ea676114e tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab" returned: 0 in 0.358s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-097b8fc7-4909-4a08-aadd-3b7ea676114e tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:58 devstack sudo[109075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab Sep 09 18:33:58 devstack sudo[109075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:58 devstack sudo[109075]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-097b8fc7-4909-4a08-aadd-3b7ea676114e tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-e674fe73-11ee-4288-85bd-29d904fc39ab" returned: 0 in 0.239s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:58 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-097b8fc7-4909-4a08-aadd-3b7ea676114e tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-e674fe73-11ee-4288-85bd-29d904fc39ab" released by "delete_volume" :: held 0.655s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:58 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-097b8fc7-4909-4a08-aadd-3b7ea676114e tempest-ProjectMemberTests-1445315730 None] Created reservations ['63dcbeb2-c4bc-411e-8d35-331d58b06161', '72d62931-b128-4179-ab07-5836e53f1145', '6af885ba-ddac-4b2f-973c-ea7d08bb4a8d', '98847cb0-fcc5-4f10-96ee-4b035b910ff9'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:33:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-097b8fc7-4909-4a08-aadd-3b7ea676114e tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-097b8fc7-4909-4a08-aadd-3b7ea676114e tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:58 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-097b8fc7-4909-4a08-aadd-3b7ea676114e tempest-ProjectMemberTests-1445315730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:58 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-097b8fc7-4909-4a08-aadd-3b7ea676114e tempest-ProjectMemberTests-1445315730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-097b8fc7-4909-4a08-aadd-3b7ea676114e tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-097b8fc7-4909-4a08-aadd-3b7ea676114e tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:58 devstack sudo[109078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:33:58 devstack sudo[109078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:58 devstack sudo[109078]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:58 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-097b8fc7-4909-4a08-aadd-3b7ea676114e tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.240s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:58 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-097b8fc7-4909-4a08-aadd-3b7ea676114e tempest-ProjectMemberTests-1445315730 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:33:58 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-097b8fc7-4909-4a08-aadd-3b7ea676114e tempest-ProjectMemberTests-1445315730 None] Deleted volume successfully. Sep 09 18:33:58 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-097b8fc7-4909-4a08-aadd-3b7ea676114e tempest-ProjectMemberTests-1445315730 None] Lock "cinder-e674fe73-11ee-4288-85bd-29d904fc39ab-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Flow 'volume_create_manager' (0e11b5b0-c578-4564-a4a8-ebf7c5019335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe2262d-0350-4735-9606-12535d118ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe2262d-0350-4735-9606-12535d118ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-250778037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b472833-1a6a-4e64-b8ec-c7eb07b1de73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16d9e4115144c68db4659423a5963a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:59Z,use_quota=True,user_id='b4c31a80b5c54f3eb121e7c39fe61f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea0b3c9-a9ac-4714-b255-3cd1ce4d758a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea0b3c9-a9ac-4714-b255-3cd1ce4d758a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1282884-a9ed-4a90-a539-d9a5873ab08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1282884-a9ed-4a90-a539-d9a5873ab08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b472833-1a6a-4e64-b8ec-c7eb07b1de73', 'volume_name': 'volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f53ca88-34db-4481-9542-90f4ad9db5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f53ca88-34db-4481-9542-90f4ad9db5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c30cad-c611-49de-99c3-7c4c32247c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:59 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Volume 3b472833-1a6a-4e64-b8ec-c7eb07b1de73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73', 'volume_size': 1} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-250778037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b472833-1a6a-4e64-b8ec-c7eb07b1de73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16d9e4115144c68db4659423a5963a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:33:59Z,use_quota=True,user_id='b4c31a80b5c54f3eb121e7c39fe61f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Creating volume 3b472833-1a6a-4e64-b8ec-c7eb07b1de73 {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:33:59 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:59 devstack sudo[109082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73 1073741824 Sep 09 18:33:59 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:59 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73 1073741824" returned: 0 in 0.394s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:33:59 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73 Sep 09 18:33:59 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:33:59 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73" returned: 0 in 0.240s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c30cad-c611-49de-99c3-7c4c32247c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (061bfd72-124f-4c94-8484-92fad478b044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:33:59 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Volume volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73 (3b472833-1a6a-4e64-b8ec-c7eb07b1de73): created successfully Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (061bfd72-124f-4c94-8484-92fad478b044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:33:59 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Flow 'volume_create_manager' (0e11b5b0-c578-4564-a4a8-ebf7c5019335) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:34:00 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-d521ac92-57c8-4b7c-b3c6-09db560133a6 tempest-ProjectMemberTests-1445315730 None] Created volume successfully. Sep 09 18:34:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1e775c9a-5826-4197-b93a-76c39cce5f5d tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:34:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1e775c9a-5826-4197-b93a-76c39cce5f5d tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:34:00 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-1e775c9a-5826-4197-b93a-76c39cce5f5d tempest-ProjectMemberTests-1445315730 None] Creating offline snapshot 52a5b0a6-3c7d-4e80-acbe-c0beaab6823a of volume 3b472833-1a6a-4e64-b8ec-c7eb07b1de73 {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:34:00 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d2183d-559f-45a9-b762-d10344560329]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:34:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1e775c9a-5826-4197-b93a-76c39cce5f5d tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:00 devstack sudo[109090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73 Sep 09 18:34:00 devstack sudo[109090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:00 devstack sudo[109090]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1e775c9a-5826-4197-b93a-76c39cce5f5d tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73" returned: 0 in 0.370s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:00 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1e775c9a-5826-4197-b93a-76c39cce5f5d tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.52a5b0a6-3c7d-4e80-acbe-c0beaab6823a 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:00 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.52a5b0a6-3c7d-4e80-acbe-c0beaab6823a 1G Sep 09 18:34:00 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:01 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1e775c9a-5826-4197-b93a-76c39cce5f5d tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.52a5b0a6-3c7d-4e80-acbe-c0beaab6823a 1G" returned: 0 in 0.386s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1e775c9a-5826-4197-b93a-76c39cce5f5d tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.52a5b0a6-3c7d-4e80-acbe-c0beaab6823a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:01 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.52a5b0a6-3c7d-4e80-acbe-c0beaab6823a Sep 09 18:34:01 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:01 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1e775c9a-5826-4197-b93a-76c39cce5f5d tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73 -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.52a5b0a6-3c7d-4e80-acbe-c0beaab6823a" returned: 0 in 0.291s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:01 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-1e775c9a-5826-4197-b93a-76c39cce5f5d tempest-ProjectMemberTests-1445315730 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.52a5b0a6-3c7d-4e80-acbe-c0beaab6823a is being set with open permissions: ugo+rw Sep 09 18:34:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1e775c9a-5826-4197-b93a-76c39cce5f5d tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.52a5b0a6-3c7d-4e80-acbe-c0beaab6823a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:01 devstack sudo[109107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.52a5b0a6-3c7d-4e80-acbe-c0beaab6823a Sep 09 18:34:01 devstack sudo[109107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:01 devstack sudo[109107]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1e775c9a-5826-4197-b93a-76c39cce5f5d tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.52a5b0a6-3c7d-4e80-acbe-c0beaab6823a" returned: 0 in 0.235s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1e775c9a-5826-4197-b93a-76c39cce5f5d tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:01 devstack sudo[109110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.info Sep 09 18:34:01 devstack sudo[109110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:01 devstack sudo[109110]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1e775c9a-5826-4197-b93a-76c39cce5f5d tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.info" returned: 0 in 0.246s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:01 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-1e775c9a-5826-4197-b93a-76c39cce5f5d tempest-ProjectMemberTests-1445315730 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.info is being set with open permissions: ugo+rw Sep 09 18:34:01 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1e775c9a-5826-4197-b93a-76c39cce5f5d tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:01 devstack sudo[109113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.info Sep 09 18:34:01 devstack sudo[109113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:02 devstack sudo[109113]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-1e775c9a-5826-4197-b93a-76c39cce5f5d tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.info" returned: 0 in 0.233s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-1e775c9a-5826-4197-b93a-76c39cce5f5d tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.835s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:34:02 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-1e775c9a-5826-4197-b93a-76c39cce5f5d tempest-ProjectMemberTests-1445315730 None] Create snapshot completed successfully Sep 09 18:34:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b7964905-46bd-42ef-82c1-dea23a27dada tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-52a5b0a6-3c7d-4e80-acbe-c0beaab6823a-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:34:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b7964905-46bd-42ef-82c1-dea23a27dada tempest-ProjectMemberTests-1445315730 None] Lock "cinder-52a5b0a6-3c7d-4e80-acbe-c0beaab6823a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:34:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b7964905-46bd-42ef-82c1-dea23a27dada tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-3b472833-1a6a-4e64-b8ec-c7eb07b1de73" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:34:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b7964905-46bd-42ef-82c1-dea23a27dada tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-3b472833-1a6a-4e64-b8ec-c7eb07b1de73" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:34:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b7964905-46bd-42ef-82c1-dea23a27dada tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-52a5b0a6-3c7d-4e80-acbe-c0beaab6823a" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:34:02 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b7964905-46bd-42ef-82c1-dea23a27dada tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-52a5b0a6-3c7d-4e80-acbe-c0beaab6823a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:34:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b7964905-46bd-42ef-82c1-dea23a27dada tempest-ProjectMemberTests-1445315730 None] Deleting offline snapshot 52a5b0a6-3c7d-4e80-acbe-c0beaab6823a of volume 3b472833-1a6a-4e64-b8ec-c7eb07b1de73 {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:34:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b7964905-46bd-42ef-82c1-dea23a27dada tempest-ProjectMemberTests-1445315730 None] snapshot_file for this snap is: volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.52a5b0a6-3c7d-4e80-acbe-c0beaab6823a {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:34:02 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe9ecee-ce70-435c-9f6d-3e3c5e879fee]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:34:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7964905-46bd-42ef-82c1-dea23a27dada tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.52a5b0a6-3c7d-4e80-acbe-c0beaab6823a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:02 devstack sudo[109116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.52a5b0a6-3c7d-4e80-acbe-c0beaab6823a Sep 09 18:34:02 devstack sudo[109116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:02 devstack sudo[109116]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7964905-46bd-42ef-82c1-dea23a27dada tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.52a5b0a6-3c7d-4e80-acbe-c0beaab6823a" returned: 0 in 0.345s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:02 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-b7964905-46bd-42ef-82c1-dea23a27dada tempest-ProjectMemberTests-1445315730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:34:02 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedda58b-9785-4fa1-b36b-81ab076d1e59]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:34:02 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7964905-46bd-42ef-82c1-dea23a27dada tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:03 devstack sudo[109121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73 Sep 09 18:34:03 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:03 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7964905-46bd-42ef-82c1-dea23a27dada tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73" returned: 0 in 0.347s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7964905-46bd-42ef-82c1-dea23a27dada tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.52a5b0a6-3c7d-4e80-acbe-c0beaab6823a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:03 devstack sudo[109126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.52a5b0a6-3c7d-4e80-acbe-c0beaab6823a Sep 09 18:34:03 devstack sudo[109126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:03 devstack sudo[109126]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7964905-46bd-42ef-82c1-dea23a27dada tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.52a5b0a6-3c7d-4e80-acbe-c0beaab6823a" returned: 0 in 0.325s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7964905-46bd-42ef-82c1-dea23a27dada tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.52a5b0a6-3c7d-4e80-acbe-c0beaab6823a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:03 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.52a5b0a6-3c7d-4e80-acbe-c0beaab6823a Sep 09 18:34:03 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:03 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:03 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b7964905-46bd-42ef-82c1-dea23a27dada tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73.52a5b0a6-3c7d-4e80-acbe-c0beaab6823a" returned: 0 in 0.243s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b7964905-46bd-42ef-82c1-dea23a27dada tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-52a5b0a6-3c7d-4e80-acbe-c0beaab6823a" released by "_delete_snapshot" :: held 1.343s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:34:03 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b7964905-46bd-42ef-82c1-dea23a27dada tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-3b472833-1a6a-4e64-b8ec-c7eb07b1de73" released by "delete_snapshot" :: held 1.366s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:34:03 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-b7964905-46bd-42ef-82c1-dea23a27dada tempest-ProjectMemberTests-1445315730 None] Created reservations ['37e8677d-79c9-4bea-96b2-e2d40dd923c6', '819cdbed-4b7d-41a5-8a6a-1467ac84ed7c', 'a6e07fb9-7dda-4228-b010-0ff1d5d69565', '3959bf36-518d-4ddf-80d7-770715968203'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:34:04 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-b7964905-46bd-42ef-82c1-dea23a27dada tempest-ProjectMemberTests-1445315730 None] Delete snapshot completed successfully. Sep 09 18:34:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b7964905-46bd-42ef-82c1-dea23a27dada tempest-ProjectMemberTests-1445315730 None] Lock "cinder-52a5b0a6-3c7d-4e80-acbe-c0beaab6823a-delete_snapshot" released by "delete_snapshot" :: held 1.498s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:34:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8ba0d9b2-f3ad-40dd-9f26-e2a99a00fa05 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-3b472833-1a6a-4e64-b8ec-c7eb07b1de73-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:34:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8ba0d9b2-f3ad-40dd-9f26-e2a99a00fa05 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-3b472833-1a6a-4e64-b8ec-c7eb07b1de73-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:34:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8ba0d9b2-f3ad-40dd-9f26-e2a99a00fa05 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-3b472833-1a6a-4e64-b8ec-c7eb07b1de73" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:34:04 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8ba0d9b2-f3ad-40dd-9f26-e2a99a00fa05 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-3b472833-1a6a-4e64-b8ec-c7eb07b1de73" acquired by "delete_volume" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:34:04 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4927395-8407-4ea7-85fb-0c6378ac3736]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:34:04 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8ba0d9b2-f3ad-40dd-9f26-e2a99a00fa05 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:04 devstack sudo[109134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73 Sep 09 18:34:04 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:05 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8ba0d9b2-f3ad-40dd-9f26-e2a99a00fa05 tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73" returned: 0 in 0.356s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8ba0d9b2-f3ad-40dd-9f26-e2a99a00fa05 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:05 devstack sudo[109139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73 Sep 09 18:34:05 devstack sudo[109139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:05 devstack sudo[109139]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8ba0d9b2-f3ad-40dd-9f26-e2a99a00fa05 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-3b472833-1a6a-4e64-b8ec-c7eb07b1de73" returned: 0 in 0.238s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8ba0d9b2-f3ad-40dd-9f26-e2a99a00fa05 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-3b472833-1a6a-4e64-b8ec-c7eb07b1de73" released by "delete_volume" :: held 0.646s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:34:05 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-8ba0d9b2-f3ad-40dd-9f26-e2a99a00fa05 tempest-ProjectMemberTests-1445315730 None] Created reservations ['40ac32fb-9ac3-4888-87c0-7a3fab10c64a', 'c6254e8c-9555-4a37-bbce-4f43fb64d454', 'ad146478-1f42-4462-b13e-cdd35e9f2b3d', 'a36a6af7-cba1-4279-b145-f8660e590d2b'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:34:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8ba0d9b2-f3ad-40dd-9f26-e2a99a00fa05 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:34:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8ba0d9b2-f3ad-40dd-9f26-e2a99a00fa05 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:34:05 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8ba0d9b2-f3ad-40dd-9f26-e2a99a00fa05 tempest-ProjectMemberTests-1445315730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:34:05 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-8ba0d9b2-f3ad-40dd-9f26-e2a99a00fa05 tempest-ProjectMemberTests-1445315730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:34:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-8ba0d9b2-f3ad-40dd-9f26-e2a99a00fa05 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:34:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8ba0d9b2-f3ad-40dd-9f26-e2a99a00fa05 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:05 devstack sudo[109142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:34:05 devstack sudo[109142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:05 devstack sudo[109142]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:05 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-8ba0d9b2-f3ad-40dd-9f26-e2a99a00fa05 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.237s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:05 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-8ba0d9b2-f3ad-40dd-9f26-e2a99a00fa05 tempest-ProjectMemberTests-1445315730 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:34:05 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-8ba0d9b2-f3ad-40dd-9f26-e2a99a00fa05 tempest-ProjectMemberTests-1445315730 None] Deleted volume successfully. Sep 09 18:34:05 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-8ba0d9b2-f3ad-40dd-9f26-e2a99a00fa05 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-3b472833-1a6a-4e64-b8ec-c7eb07b1de73-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87639) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Flow 'volume_create_manager' (523e9cda-7e05-460e-b000-97929485de8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b953084-021f-48b5-992c-350d9ba18599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b953084-021f-48b5-992c-350d9ba18599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1952878586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc5c1ef8-23dd-4a35-a46c-17983353a78a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16d9e4115144c68db4659423a5963a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:34:06Z,use_quota=True,user_id='b4c31a80b5c54f3eb121e7c39fe61f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0144ed5-c286-42be-8119-e5765807b236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0144ed5-c286-42be-8119-e5765807b236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce6034f-a944-4424-b97e-82d3d778e94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce6034f-a944-4424-b97e-82d3d778e94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc5c1ef8-23dd-4a35-a46c-17983353a78a', 'volume_name': 'volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3e169a-6e29-4e48-9063-fc0b12aef40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3e169a-6e29-4e48-9063-fc0b12aef40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a25235c-3db2-49d1-b756-24a7227589a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:34:06 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Volume fc5c1ef8-23dd-4a35-a46c-17983353a78a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a', 'volume_size': 1} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T16:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1952878586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc5c1ef8-23dd-4a35-a46c-17983353a78a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e16d9e4115144c68db4659423a5963a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T16:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T16:34:06Z,use_quota=True,user_id='b4c31a80b5c54f3eb121e7c39fe61f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8008bce-b2e8-4094-98fa-73e21466eda3),volume_type_id=e8008bce-b2e8-4094-98fa-73e21466eda3)}" {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Creating volume fc5c1ef8-23dd-4a35-a46c-17983353a78a {{(pid=87639) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Selected osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f as target Quobyte volume. {{(pid=87639) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 18:34:06 devstack cinder-volume[87639]: INFO cinder.volume.drivers.remotefs [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] casted to osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a 1073741824 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:06 devstack sudo[109146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a 1073741824 Sep 09 18:34:06 devstack sudo[109146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:06 devstack sudo[109146]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a 1073741824" returned: 0 in 0.387s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:06 devstack sudo[109151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a Sep 09 18:34:06 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:06 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a" returned: 0 in 0.241s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'} {{(pid=87639) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 09 18:34:06 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:34:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a25235c-3db2-49d1-b756-24a7227589a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a', 'volume_size': 1}' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:34:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc46abd4-5488-45cd-a86d-fa4ee55c2e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 18:34:07 devstack cinder-volume[87639]: INFO cinder.volume.flows.manager.create_volume [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Volume volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a (fc5c1ef8-23dd-4a35-a46c-17983353a78a): created successfully Sep 09 18:34:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc46abd4-5488-45cd-a86d-fa4ee55c2e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87639) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 18:34:07 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Flow 'volume_create_manager' (523e9cda-7e05-460e-b000-97929485de8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87639) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 18:34:07 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-e4d075d0-4dc9-43d6-a568-3365d0cc4c09 tempest-ProjectMemberTests-1445315730 None] Created volume successfully. Sep 09 18:34:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ad1105fc-f3cc-4170-a225-83dc7b56c08a tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:34:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ad1105fc-f3cc-4170-a225-83dc7b56c08a tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:34:07 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-ad1105fc-f3cc-4170-a225-83dc7b56c08a tempest-ProjectMemberTests-1445315730 None] Creating offline snapshot 2d676abd-8422-454c-8057-657c746a86da of volume fc5c1ef8-23dd-4a35-a46c-17983353a78a {{(pid=87639) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 18:34:07 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a98c59-5edb-46b7-9583-f4d0212a836a]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:34:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ad1105fc-f3cc-4170-a225-83dc7b56c08a tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:07 devstack sudo[109154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a Sep 09 18:34:07 devstack sudo[109154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:07 devstack sudo[109154]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ad1105fc-f3cc-4170-a225-83dc7b56c08a tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a" returned: 0 in 0.340s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:07 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ad1105fc-f3cc-4170-a225-83dc7b56c08a tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.2d676abd-8422-454c-8057-657c746a86da 1G {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:07 devstack sudo[109159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.2d676abd-8422-454c-8057-657c746a86da 1G Sep 09 18:34:07 devstack sudo[109159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:08 devstack sudo[109159]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ad1105fc-f3cc-4170-a225-83dc7b56c08a tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.2d676abd-8422-454c-8057-657c746a86da 1G" returned: 0 in 0.373s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ad1105fc-f3cc-4170-a225-83dc7b56c08a tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.2d676abd-8422-454c-8057-657c746a86da {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:08 devstack sudo[109165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.2d676abd-8422-454c-8057-657c746a86da Sep 09 18:34:08 devstack sudo[109165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:08 devstack sudo[109165]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ad1105fc-f3cc-4170-a225-83dc7b56c08a tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a -F qcow2 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.2d676abd-8422-454c-8057-657c746a86da" returned: 0 in 0.273s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:08 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-ad1105fc-f3cc-4170-a225-83dc7b56c08a tempest-ProjectMemberTests-1445315730 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.2d676abd-8422-454c-8057-657c746a86da is being set with open permissions: ugo+rw Sep 09 18:34:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ad1105fc-f3cc-4170-a225-83dc7b56c08a tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.2d676abd-8422-454c-8057-657c746a86da {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:08 devstack sudo[109170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.2d676abd-8422-454c-8057-657c746a86da Sep 09 18:34:08 devstack sudo[109170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:08 devstack sudo[109170]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ad1105fc-f3cc-4170-a225-83dc7b56c08a tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.2d676abd-8422-454c-8057-657c746a86da" returned: 0 in 0.233s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ad1105fc-f3cc-4170-a225-83dc7b56c08a tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:08 devstack sudo[109173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.info Sep 09 18:34:08 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:08 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ad1105fc-f3cc-4170-a225-83dc7b56c08a tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.info" returned: 0 in 0.241s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:08 devstack cinder-volume[87639]: WARNING cinder.volume.drivers.remotefs [None req-ad1105fc-f3cc-4170-a225-83dc7b56c08a tempest-ProjectMemberTests-1445315730 None] /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.info is being set with open permissions: ugo+rw Sep 09 18:34:08 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ad1105fc-f3cc-4170-a225-83dc7b56c08a tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.info {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:08 devstack sudo[109190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.info Sep 09 18:34:08 devstack sudo[109190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:09 devstack sudo[109190]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-ad1105fc-f3cc-4170-a225-83dc7b56c08a tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.info" returned: 0 in 0.277s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-ad1105fc-f3cc-4170-a225-83dc7b56c08a tempest-ProjectMemberTests-1445315730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.806s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:34:09 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-ad1105fc-f3cc-4170-a225-83dc7b56c08a tempest-ProjectMemberTests-1445315730 None] Create snapshot completed successfully Sep 09 18:34:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2201a90b-8b02-4758-a00e-5a95db6651b1 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-2d676abd-8422-454c-8057-657c746a86da-delete_snapshot" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:34:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2201a90b-8b02-4758-a00e-5a95db6651b1 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-2d676abd-8422-454c-8057-657c746a86da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:34:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2201a90b-8b02-4758-a00e-5a95db6651b1 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-fc5c1ef8-23dd-4a35-a46c-17983353a78a" by "delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:34:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2201a90b-8b02-4758-a00e-5a95db6651b1 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-fc5c1ef8-23dd-4a35-a46c-17983353a78a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:34:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2201a90b-8b02-4758-a00e-5a95db6651b1 tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-2d676abd-8422-454c-8057-657c746a86da" by "_delete_snapshot" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:34:09 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2201a90b-8b02-4758-a00e-5a95db6651b1 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-2d676abd-8422-454c-8057-657c746a86da" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:34:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-2201a90b-8b02-4758-a00e-5a95db6651b1 tempest-ProjectMemberTests-1445315730 None] Deleting offline snapshot 2d676abd-8422-454c-8057-657c746a86da of volume fc5c1ef8-23dd-4a35-a46c-17983353a78a {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 18:34:09 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-2201a90b-8b02-4758-a00e-5a95db6651b1 tempest-ProjectMemberTests-1445315730 None] snapshot_file for this snap is: volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.2d676abd-8422-454c-8057-657c746a86da {{(pid=87639) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 18:34:09 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f26c64-5385-439a-bff9-e66a80b9d9da]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:34:09 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2201a90b-8b02-4758-a00e-5a95db6651b1 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.2d676abd-8422-454c-8057-657c746a86da {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:09 devstack sudo[109215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.2d676abd-8422-454c-8057-657c746a86da Sep 09 18:34:09 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:10 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2201a90b-8b02-4758-a00e-5a95db6651b1 tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.2d676abd-8422-454c-8057-657c746a86da" returned: 0 in 0.350s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:10 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.remotefs [None req-2201a90b-8b02-4758-a00e-5a95db6651b1 tempest-ProjectMemberTests-1445315730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87639) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 18:34:10 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c0dc67-e629-4a10-9889-df7185341eed]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:34:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2201a90b-8b02-4758-a00e-5a95db6651b1 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:10 devstack sudo[109220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a Sep 09 18:34:10 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:10 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2201a90b-8b02-4758-a00e-5a95db6651b1 tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a" returned: 0 in 0.343s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2201a90b-8b02-4758-a00e-5a95db6651b1 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.2d676abd-8422-454c-8057-657c746a86da {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:10 devstack sudo[109225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.2d676abd-8422-454c-8057-657c746a86da Sep 09 18:34:10 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:10 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2201a90b-8b02-4758-a00e-5a95db6651b1 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.2d676abd-8422-454c-8057-657c746a86da" returned: 0 in 0.332s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2201a90b-8b02-4758-a00e-5a95db6651b1 tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.2d676abd-8422-454c-8057-657c746a86da {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:10 devstack sudo[109230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.2d676abd-8422-454c-8057-657c746a86da Sep 09 18:34:10 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:10 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:10 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-2201a90b-8b02-4758-a00e-5a95db6651b1 tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a.2d676abd-8422-454c-8057-657c746a86da" returned: 0 in 0.233s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:10 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2201a90b-8b02-4758-a00e-5a95db6651b1 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-2d676abd-8422-454c-8057-657c746a86da" released by "_delete_snapshot" :: held 1.336s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:34:11 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2201a90b-8b02-4758-a00e-5a95db6651b1 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-fc5c1ef8-23dd-4a35-a46c-17983353a78a" released by "delete_snapshot" :: held 1.356s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:34:11 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-2201a90b-8b02-4758-a00e-5a95db6651b1 tempest-ProjectMemberTests-1445315730 None] Created reservations ['6a481d02-9f73-4312-8416-77c7dd8c5812', '8dd5194c-1a6a-451a-b29c-b5ab973568ba', 'ccf54476-b2a5-4acc-bf8c-445147b0f459', 'cf7444f7-cc6e-4685-9493-e332ece57098'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:34:11 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-2201a90b-8b02-4758-a00e-5a95db6651b1 tempest-ProjectMemberTests-1445315730 None] Delete snapshot completed successfully. Sep 09 18:34:11 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-2201a90b-8b02-4758-a00e-5a95db6651b1 tempest-ProjectMemberTests-1445315730 None] Lock "cinder-2d676abd-8422-454c-8057-657c746a86da-delete_snapshot" released by "delete_snapshot" :: held 1.487s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:34:11 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b41bb6a1-3183-4f42-9580-45072b5f0f2b tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-fc5c1ef8-23dd-4a35-a46c-17983353a78a-delete_volume" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:34:11 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b41bb6a1-3183-4f42-9580-45072b5f0f2b tempest-ProjectMemberTests-1445315730 None] Lock "cinder-fc5c1ef8-23dd-4a35-a46c-17983353a78a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:34:11 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b41bb6a1-3183-4f42-9580-45072b5f0f2b tempest-ProjectMemberTests-1445315730 None] Acquiring lock "cinder-quobyte-fc5c1ef8-23dd-4a35-a46c-17983353a78a" by "delete_volume" {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 18:34:11 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b41bb6a1-3183-4f42-9580-45072b5f0f2b tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-fc5c1ef8-23dd-4a35-a46c-17983353a78a" acquired by "delete_volume" :: waited 0.016s {{(pid=87639) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 18:34:11 devstack cinder-volume[87639]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6bc598-c5e4-4f13-893b-596bfb8cf729]: (4, 'qcow2') {{(pid=89535) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 18:34:11 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b41bb6a1-3183-4f42-9580-45072b5f0f2b tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:11 devstack sudo[109233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a Sep 09 18:34:11 devstack sudo[109233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:12 devstack sudo[109233]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b41bb6a1-3183-4f42-9580-45072b5f0f2b tempest-ProjectMemberTests-1445315730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a" returned: 0 in 0.342s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b41bb6a1-3183-4f42-9580-45072b5f0f2b tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:12 devstack sudo[109238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a Sep 09 18:34:12 devstack sudo[109238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:12 devstack sudo[109238]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b41bb6a1-3183-4f42-9580-45072b5f0f2b tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006/volume-fc5c1ef8-23dd-4a35-a46c-17983353a78a" returned: 0 in 0.267s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b41bb6a1-3183-4f42-9580-45072b5f0f2b tempest-ProjectMemberTests-1445315730 None] Lock "cinder-quobyte-fc5c1ef8-23dd-4a35-a46c-17983353a78a" released by "delete_volume" :: held 0.662s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:34:12 devstack cinder-volume[87639]: DEBUG cinder.quota [None req-b41bb6a1-3183-4f42-9580-45072b5f0f2b tempest-ProjectMemberTests-1445315730 None] Created reservations ['74c31a08-243a-46b6-b6cf-724045f913de', '845f4a52-c5c9-431a-853f-2697975a3aac', 'c185dc24-80e2-4399-9dd0-9f00381a5fa2', '0380cdcb-349e-4386-9d4c-8d57a6c06577'] {{(pid=87639) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 18:34:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b41bb6a1-3183-4f42-9580-45072b5f0f2b tempest-ProjectMemberTests-1445315730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:34:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b41bb6a1-3183-4f42-9580-45072b5f0f2b tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:34:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b41bb6a1-3183-4f42-9580-45072b5f0f2b tempest-ProjectMemberTests-1445315730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:34:12 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-b41bb6a1-3183-4f42-9580-45072b5f0f2b tempest-ProjectMemberTests-1445315730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:34:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-b41bb6a1-3183-4f42-9580-45072b5f0f2b tempest-ProjectMemberTests-1445315730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:34:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b41bb6a1-3183-4f42-9580-45072b5f0f2b tempest-ProjectMemberTests-1445315730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:12 devstack sudo[109241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:34:12 devstack sudo[109241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:12 devstack sudo[109241]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:12 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-b41bb6a1-3183-4f42-9580-45072b5f0f2b tempest-ProjectMemberTests-1445315730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.237s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:12 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-b41bb6a1-3183-4f42-9580-45072b5f0f2b tempest-ProjectMemberTests-1445315730 None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:34:12 devstack cinder-volume[87639]: INFO cinder.volume.manager [None req-b41bb6a1-3183-4f42-9580-45072b5f0f2b tempest-ProjectMemberTests-1445315730 None] Deleted volume successfully. Sep 09 18:34:12 devstack cinder-volume[87639]: DEBUG cinder.coordination [None req-b41bb6a1-3183-4f42-9580-45072b5f0f2b tempest-ProjectMemberTests-1445315730 None] Lock "cinder-fc5c1ef8-23dd-4a35-a46c-17983353a78a-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87639) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 18:34:25 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=65,cinder:DELETE=8,cinder:UPDATE=88,cinder:INSERT=24 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:34:25 devstack cinder-volume[87639]: DEBUG dbcounter [-] [87639] Writing DB stats cinder:SELECT=67,cinder:UPDATE=83,cinder:DELETE=6,cinder:INSERT=24 {{(pid=87639) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 18:34:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:34:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 18:34:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 18:34:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f': None} {{(pid=87639) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 18:34:43 devstack cinder-volume[87639]: DEBUG cinder.volume.drivers.quobyte [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5659e036-9999-4e85-9b04-e1fd85dd585f'] {{(pid=87639) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 18:34:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.lockutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87639) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 18:34:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 18:34:43 devstack sudo[109326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006 Sep 09 18:34:43 devstack sudo[109326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 18:34:43 devstack sudo[109326]: pam_unix(sudo:session): session closed for user root Sep 09 18:34:43 devstack cinder-volume[87639]: DEBUG oslo_concurrency.processutils [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d9d3df3c66a71d90e54a17cd42a3c006" returned: 0 in 0.235s {{(pid=87639) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 18:34:43 devstack cinder-volume[87639]: DEBUG cinder.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Notifying Schedulers of capabilities ... {{(pid=87639) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 18:34:43 devstack cinder-volume[87639]: DEBUG oslo_service.periodic_task [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] Running periodic task VolumeManager._thread_info {{(pid=87639) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 18:34:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread count: 29 {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 18:34:43 devstack cinder-volume[87639]: DEBUG cinder.volume.manager [None req-cc2cbe85-1a22-4be4-b3c9-2a1386ab0719 None None] thread info: [<_MainThread(MainThread, started 138602150416512)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87639) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}